Work in Progress (Following are the lecture notes of Prof Percy Liang/Prof Dorsa Sadigh - CS221 - Stanford. This is my interpretation of their excellent teaching and I take full responsibility of any misinterpretation or misinformation provided herein.)

Lecture 02

Outline

  • Linear Predictors
  • Loss minimization
  • Stochastic gradient descent

Linear Predictors

Application: spam classification

Input x = email message Output y $\in$ {spam, not spam}

Types of prediction tasks

  • Binary classification (email $\Rightarrow$ spam/not spam)

    $x \rightarrow \fbox{f} \rightarrow y \in ${+1, -1}

  • Regression (location, year $\Rightarrow$ housing price)

    $x \rightarrow \fbox{f} \rightarrow y \in \mathbb R$

  • Multiclass classification: y is a category

    100 Images $\rightarrow \fbox{f} \rightarrow cat$

  • Ranking: y is a permutation

    1 2 3 4 $\rightarrow \fbox{f} \rightarrow$ 2 3 4 1

  • Structured prediction: build from parts, construct

    la casa blue $\rightarrow \fbox{f} \rightarrow$ the blue house

  • many more..

Feature extraction

  • What properties of x might be relevant for predicting y?

    Input $\xrightarrow[\text{}]{\text{feature extractor}} \fbox{Feature Name: Feature Value}$

$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$


Feature vector

$\phi(x) \in \mathbb R^{d} $

Weight vector

  • $\in \mathbb R^{d} $

Score

  • weighted combinations of features $\in \mathbb R $
  • the score on an example (x,y) is $w.\phi(x)$, how confident we are in predicting +1
  • the magnitude of w does not matter, as the orthogonal vector(decision boundary) will still be the same
    • when used for prediction, the magnitude of boundary does not matter
    • when used for learning, the magnitude matters

      $w.\phi(x) = \sum_{j=1}^{d}w_{j}\phi(x)_{j}$


Linear classifier (predictor)

  • binary in this case: $f_{w}$

    $f_{w} = \text{sign}(w.\phi(x)) = \begin{cases} +1 & \text{if $w.\phi(x) > 0$}\\ -1 & \text{if $w.\phi(x) < 0$}\\ ? & \text{if $w.\phi(x) = 0$} \end{cases} $

  • Example:
    • w = [2,-1]
    • $\phi(x) \in \{[2,0],[0,2],[2,4]\}$

$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$


Margin

  • Margin on an example (x,y) is $(w.\phi(x))y$, how correct we are
  • Margin less than 0 means that y and scores are different signs are there is a mistake

Zero-one (0-1) loss

  • did you make mist

    $\begin{split} \text{Loss}_{0-1}(x,y,w) & = \mathbb 1[f_{w} \neq y] \\ & = \mathbb 1[(w.\phi(x))y \le 0] \\ & = \mathbb 1[\text{Margin} \le 0] \end{split}$

  • is an indicator function that takes condition and returns 1 or 0
    • if condition is true, returns 1, else 0
    • if margin is less than 0, we have made a mistake


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$


  • Loss function: how good is a predictor?
    • its a number, which helps us understand if we are satisfied with the prediction, if we use w to make prediction on x when the correct output is y
    • Loss is on a particular example(residual square), TrainLoss is on a complete set(sum of residual square)
    • High loss is bad, low loss is good

      Squared Loss(x,y,w)$= (f_{w}(x)-y)^{2} = (w.\phi(x) - y)^{2}$
      Train Loss(w)$=\frac{1}{|\mathbb D_{train}|}\sum_{(x,y)\in\mathbb D_{\text{train}}}\text{Loss(x,y,w)}$


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$


Optimization algorithm

  • how to compute best?

    • Goal: min$_{w}$TrainLoss(w)
    • gradient $\nabla_{w}$TrainLoss(w) is the direction that increases the training loss the most
      • use chain rule and do derivative
    • step size $\eta$

      Initialize w = [0,..0]
      For t = 1,..,T: (epochs)
      $\ \ \ w \leftarrow w - \eta\nabla_{w}$TrainLoss(w)

    • Level curves

  • If prediction = target, gradient is zero


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$

Learner

  • Optimization problem
    • what properties do we want the classifier to have in terms of data
  • Optimization algorithm

    • how to optimize this
  • Loss function Loss(x,y,w) quantifies

Gradient Descent

  • Gradient descent is slow
    • gradient is calculation of the training loss
    • and training loss is the sum of all the points
    • which makes it expensive
    • how to avoid this?
      • Stochastic gradient descent
        • Rather than looping through all the training examples to compute a single gradient and making one step(which is expensive)
        • loop through the example and update the weight w based on each example
        • update wont be good, but can make many more updates


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$

- Step size
  - 0 - too conservative
  - 1 - too aggressive
  - Strategy
    > Constant: $\eta = 0.1$  
    > Decreasing: $\eta = 1/\sqrt{\text{# updates made so far}}$        

Classification - Will SGD work on 0-1Loss?

  • No? Why?
    • 1) Its not differentiable
    • 2) The gradient is zero everywhere other than at 0, which does not matter
      • The weights will not move


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$

  • How to solve this?
    • Make the gradient non-zero
    • Hinge loss
      • Loss$_{hinge}(x,y,w) = \text{max}\{1-(w.\phi(x))y, 0\}$


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$

- Calculate gradient of this hinge loss  
  > $\nabla\text{Loss}_{hinge}(x,y,w) =   
  \begin{cases}  
  -\phi{(x)}y & \text{if} \{1-(w.\phi(x))y\} > \{0\} \\   
  0 & \text{otherwise}   
  \end{cases}  
  $   
  > or    
  > $\nabla\text{Loss}_{hinge}(x,y,w) =   
  \begin{cases}   
            0 & \text{if} \{w.\phi(x))y\} > \{1\} \\   
  -\phi{(x)}y & \text{otherwise}   
  \end{cases}  
  $   
  • Other type of loss function for classification
    • Logistic


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$

Example - Gradient Descent - Vectorized

In [1]:
# %load lec02-c02-gradientDescentVectorized.py
import pandas as pd
import numpy as np

# pd.set_option('display.max_columns', None)
# pd.set_option('display.max_colwidth', None)

##############################################
# Model

# points = [(np.array([2]),4), (np.array([4]),2)]
# d = 1

# Generate data
iterationCount = 2000
true_w = np.array([1,2,3,4,5,]) # Reverse-engineer to get to this vector
d = len(true_w)
dfColNames = [f"w{s+1}" for s in range(d)]
dfColNames.append('F(w)')
points = []
for i in range(iterationCount):
    x = np.random.randn(d)
    y = true_w.dot(x) + np.random.randn()
    points.append((x,y))


def F(w):
    return sum((w.dot(x) - y)**2 for x, y in points) / len(points)

def dF(w):
    return sum(2*(w.dot(x) - y) * x for x, y in points) / len(points)

##############################################
# Algorithm

def gradientDescent(F, dF, d):
    w = np.zeros(d)
    eta = 0.01

    lst = []
    for t in range(iterationCount):
        l1 = []
        value = F(w)
        gradient = dF(w)
        w = w - eta * gradient
        l1.extend(w)
        l1.append(value)
        lst.append(l1)
    df = pd.DataFrame(lst, columns = dfColNames)
    df['Iteration'] = df.index
    return df

result = gradientDescent(F, dF, d)

# print(result)
In [2]:
! python lec02-c02-gradientDescentVectorized.py 

import plotly.express as px
import numpy as np

result1 = result.melt(id_vars=['Iteration', 'F(w)'], \
            value_vars=['w1', 'w2', 'w3', 'w4', 'w5'], \
            var_name='w')
# print(result1)
xMin = np.floor(min(result1['value']))
xMax = np.ceil(max(result1['value']))
yMin = np.floor(min(result1['F(w)']))
yMax = np.ceil(max(result1['F(w)']))


# #Creating animation using plotly express
fig = px.line(result1, x="value", y="F(w)", 
#          animation_frame="Iteration", 
#               animation_group="w",
#            size="F(w)", # color="continent", hover_name="country",
#            log_y=True, # size_max=55, 
           color = "w",
           range_x=[xMin,xMax], range_y=[yMin,yMax],
           markers=True,
                )
# fig.update_traces()
fig.show()
fig.write_image("images/02_c02_gd.png")

Example - Stochastic Gradient Descent

In [3]:
# %load lec02-c03-stochasticGradientDescent.py
import numpy as np

##########################################################################
# Modeling: what we want to capture

# points = [(np.array([2]),4), (np.array([4]),2)]
# d = 1

# Generate artificial data
true_w = np.array([1,2,3,4,5])
d = len(true_w)
points = []
iterationCount = 500
for i in range(iterationCount):
    x = np.random.randn(d)
    y = true_w.dot(x) + np.random.randn()
    #  print(x, y)
    points.append((x,y))


def F(w):
    return sum((w.dot(x) - y)**2 for x, y in points) / len(points)

def dF(w):
    return sum(2*(w.dot(x) - y)*x  for x, y in points) / len(points)

def sF(w, i):
    x,y = points[i]
    return (w.dot(x) - y)**2

def sdF(w, i):
    x,y = points[i]
    return 2*(w.dot(x) - y)*x 



##########################################################################
# Algorithms: how we compute it 

def gradientDescent(F, dF, d):
    # gradient descent
    w = np.zeros(d)
    eta = 0.01
    for t in range(iterationCount):
        value = F(w)
        gradient = dF(w)
        w = w - eta * gradient
        print('iteration {}: w = {}, F(w) = {}'.format(t, w, value))

def stochasticGradientDescent(sF, sdF, d, n):
    # stochastic gradient descent
    w = np.zeros(d)
    eta = 1
    numUpdates = 0
    for t in range(iterationCount):
        for i in range(n):
            value = sF(w, i)
            gradient = sdF(w, i)
            numUpdates += 1
            eta = 1 / numUpdates
            w = w - eta * gradient
        print('iteration {}: w = {}, F(w) = {}'.format(t, w, value))


##########################################################################
# gradientDescent(F, dF, d)
stochasticGradientDescent(sF, sdF, d, len(points))
iteration 0: w = [1.11001994 1.96311751 3.04617019 4.03418469 5.05178579], F(w) = 0.3684719304237501
iteration 1: w = [1.09576148 1.9656774  3.05099849 4.03142389 5.03611595], F(w) = 0.36134339250816555
iteration 2: w = [1.092828   1.96766668 3.0504411  4.02769041 5.03085297], F(w) = 0.36473804229074586
iteration 3: w = [1.09177064 1.96884828 3.04975783 4.0252496  5.02818704], F(w) = 0.36749732881181335
iteration 4: w = [1.09128046 1.96961296 3.0492191  4.0235922  5.02657006], F(w) = 0.3694929950208076
iteration 5: w = [1.09101779 1.97014486 3.0488065  4.02240399 5.02548264], F(w) = 0.37096557212665104
iteration 6: w = [1.09086313 1.97053525 3.04848568 4.02151332 5.02470037], F(w) = 0.3720872618846346
iteration 7: w = [1.09076587 1.9708336  3.04823082 4.02082183 5.02411019], F(w) = 0.3729668536204646
iteration 8: w = [1.09070169 1.97106886 3.04802417 4.0202698  5.02364888], F(w) = 0.37367376283116605
iteration 9: w = [1.09065777 1.97125905 3.04785354 4.01981907 5.02327825], F(w) = 0.3742536860015068
iteration 10: w = [1.09062686 1.97141596 3.04771043 4.01944417 5.02297389], F(w) = 0.3747377135217631
iteration 11: w = [1.09060463 1.97154759 3.04758876 4.01912748 5.02271943], F(w) = 0.37514764965488945
iteration 12: w = [1.09058837 1.97165958 3.0474841  4.01885645 5.0225035 ], F(w) = 0.3754992028172382
iteration 13: w = [1.09057634 1.97175601 3.04739314 4.01862187 5.02231794], F(w) = 0.37580396001008004
iteration 14: w = [1.09056734 1.97183991 3.04731338 4.01841685 5.02215676], F(w) = 0.37607064695387094
iteration 15: w = [1.09056058 1.97191357 3.04724288 4.01823614 5.02201543], F(w) = 0.37630595552946555
iteration 16: w = [1.09055549 1.97197875 3.04718012 4.01807566 5.02189049], F(w) = 0.37651510127797266
iteration 17: w = [1.09055165 1.97203684 3.0471239  4.01793219 5.02177924], F(w) = 0.37670220783823855
iteration 18: w = [1.09054879 1.97208893 3.04707326 4.01780317 5.02167954], F(w) = 0.37687057763432186
iteration 19: w = [1.09054666 1.9721359  3.0470274  4.01768651 5.02158968], F(w) = 0.3770228860878547
iteration 20: w = [1.09054512 1.97217848 3.04698568 4.01758052 5.02150827], F(w) = 0.3771613233486871
iteration 21: w = [1.09054403 1.97221724 3.04694756 4.01748379 5.02143416], F(w) = 0.3772876993315733
iteration 22: w = [1.0905433  1.97225269 3.0469126  4.01739518 5.02136643], F(w) = 0.37740352265781524
iteration 23: w = [1.09054286 1.97228522 3.04688043 4.01731368 5.02130426], F(w) = 0.37751006074872345
iteration 24: w = [1.09054264 1.97231519 3.04685071 4.01723849 5.02124702], F(w) = 0.37760838611090053
iteration 25: w = [1.0905426  1.97234289 3.04682319 4.01716889 5.02119412], F(w) = 0.3776994123721696
iteration 26: w = [1.0905427  1.97236855 3.04679763 4.01710428 5.0211451 ], F(w) = 0.37778392261802085
iteration 27: w = [1.09054292 1.97239241 3.04677382 4.01704415 5.02109954], F(w) = 0.37786259187940435
iteration 28: w = [1.09054323 1.97241464 3.0467516  4.01698804 5.02105709], F(w) = 0.3779360051315021
iteration 29: w = [1.09054361 1.9724354  3.0467308  4.01693556 5.02101744], F(w) = 0.37800467181429137
iteration 30: w = [1.09054405 1.97245484 3.0467113  4.01688638 5.02098032], F(w) = 0.3780690376338688
iteration 31: w = [1.09054453 1.97247308 3.04669298 4.01684018 5.02094549], F(w) = 0.3781294942199384
iteration 32: w = [1.09054505 1.97249022 3.04667573 4.01679672 5.02091276], F(w) = 0.37818638708026203
iteration 33: w = [1.09054559 1.97250637 3.04665946 4.01675574 5.02088193], F(w) = 0.37824002219212877
iteration 34: w = [1.09054616 1.9725216  3.0466441  4.01671705 5.02085285], F(w) = 0.37829067149546175
iteration 35: w = [1.09054674 1.97253599 3.04662957 4.01668045 5.02082536], F(w) = 0.3783385774953191
iteration 36: w = [1.09054733 1.97254961 3.04661579 4.01664579 5.02079935], F(w) = 0.3783839571376096
iteration 37: w = [1.09054792 1.97256252 3.04660273 4.0166129  5.0207747 ], F(w) = 0.3784270050885211
iteration 38: w = [1.09054852 1.97257477 3.04659031 4.01658167 5.02075129], F(w) = 0.37846789652177226
iteration 39: w = [1.09054912 1.97258641 3.0465785  4.01655196 5.02072905], F(w) = 0.3785067894979352
iteration 40: w = [1.09054972 1.9725975  3.04656725 4.01652367 5.02070788], F(w) = 0.37854382700363937
iteration 41: w = [1.09055031 1.97260805 3.04655653 4.0164967  5.02068771], F(w) = 0.3785791387060789
iteration 42: w = [1.0905509  1.97261812 3.04654629 4.01647096 5.02066847], F(w) = 0.3786128424682389
iteration 43: w = [1.09055148 1.97262774 3.0465365  4.01644636 5.0206501 ], F(w) = 0.37864504566169804
iteration 44: w = [1.09055206 1.97263693 3.04652714 4.01642284 5.02063254], F(w) = 0.3786758463084287
iteration 45: w = [1.09055263 1.97264572 3.04651818 4.01640032 5.02061573], F(w) = 0.378705334076398
iteration 46: w = [1.09055319 1.97265415 3.04650959 4.01637873 5.02059963], F(w) = 0.3787335911508197
iteration 47: w = [1.09055374 1.97266222 3.04650135 4.01635803 5.0205842 ], F(w) = 0.37876069299857346
iteration 48: w = [1.09055429 1.97266997 3.04649344 4.01633816 5.0205694 ], F(w) = 0.37878670904077766
iteration 49: w = [1.09055482 1.97267741 3.04648584 4.01631907 5.02055518], F(w) = 0.3788117032462515
iteration 50: w = [1.09055535 1.97268455 3.04647853 4.01630072 5.02054151], F(w) = 0.37883573465631565
iteration 51: w = [1.09055586 1.97269143 3.0464715  4.01628305 5.02052837], F(w) = 0.3788588578502843
iteration 52: w = [1.09055637 1.97269805 3.04646473 4.01626605 5.02051572], F(w) = 0.3788811233590397
iteration 53: w = [1.09055687 1.97270442 3.0464582  4.01624966 5.02050353], F(w) = 0.3789025780335145
iteration 54: w = [1.09055736 1.97271056 3.0464519  4.01623386 5.02049178], F(w) = 0.3789232653736971
iteration 55: w = [1.09055784 1.97271649 3.04644583 4.01621861 5.02048045], F(w) = 0.3789432258228476
iteration 56: w = [1.09055831 1.97272221 3.04643997 4.01620389 5.02046952], F(w) = 0.37896249703137475
iteration 57: w = [1.09055877 1.97272773 3.0464343  4.01618967 5.02045896], F(w) = 0.37898111409376406
iteration 58: w = [1.09055922 1.97273307 3.04642882 4.01617592 5.02044875], F(w) = 0.3789991097618449
iteration 59: w = [1.09055966 1.97273822 3.04642353 4.01616263 5.02043888], F(w) = 0.37901651463701547
iteration 60: w = [1.0905601  1.97274321 3.0464184  4.01614976 5.02042934], F(w) = 0.3790333573439207
iteration 61: w = [1.09056052 1.97274804 3.04641343 4.01613731 5.02042009], F(w) = 0.37904966468739487
iteration 62: w = [1.09056094 1.97275272 3.04640863 4.01612524 5.02041114], F(w) = 0.3790654617949512
iteration 63: w = [1.09056135 1.97275725 3.04640396 4.01611354 5.02040247], F(w) = 0.37908077224585973
iteration 64: w = [1.09056175 1.97276165 3.04639944 4.0161022  5.02039407], F(w) = 0.37909561818859117
iteration 65: w = [1.09056215 1.97276591 3.04639506 4.0160912  5.02038591], F(w) = 0.37911002044772696
iteration 66: w = [1.09056253 1.97277004 3.0463908  4.01608052 5.020378  ], F(w) = 0.37912399862142343
iteration 67: w = [1.09056291 1.97277406 3.04638667 4.01607015 5.02037032], F(w) = 0.37913757117034663
iteration 68: w = [1.09056328 1.97277795 3.04638265 4.01606008 5.02036286], F(w) = 0.3791507554989948
iteration 69: w = [1.09056365 1.97278174 3.04637875 4.01605029 5.02035561], F(w) = 0.37916356803026274
iteration 70: w = [1.09056401 1.97278542 3.04637496 4.01604077 5.02034857], F(w) = 0.3791760242735714
iteration 71: w = [1.09056436 1.972789   3.04637127 4.01603152 5.02034172], F(w) = 0.3791881388875674
iteration 72: w = [1.0905647  1.97279248 3.04636768 4.01602251 5.02033505], F(w) = 0.3791999257376247
iteration 73: w = [1.09056504 1.97279587 3.04636418 4.01601375 5.02032857], F(w) = 0.3792113979488197
iteration 74: w = [1.09056537 1.97279916 3.04636078 4.01600521 5.02032225], F(w) = 0.379222567954675
iteration 75: w = [1.09056569 1.97280237 3.04635746 4.0159969  5.02031611], F(w) = 0.379233447542153
iteration 76: w = [1.09056601 1.9728055  3.04635424 4.0159888  5.02031012], F(w) = 0.37924404789302935
iteration 77: w = [1.09056633 1.97280855 3.04635109 4.0159809  5.02030428], F(w) = 0.37925437962238223
iteration 78: w = [1.09056663 1.97281152 3.04634802 4.01597321 5.02029859], F(w) = 0.3792644528139553
iteration 79: w = [1.09056694 1.97281442 3.04634502 4.0159657  5.02029304], F(w) = 0.3792742770529919
iteration 80: w = [1.09056723 1.97281724 3.0463421  4.01595838 5.02028763], F(w) = 0.37928386145669846
iteration 81: w = [1.09056752 1.97282    3.04633925 4.01595123 5.02028235], F(w) = 0.37929321470244837
iteration 82: w = [1.09056781 1.97282269 3.04633647 4.01594425 5.02027719], F(w) = 0.3793023450540098
iteration 83: w = [1.09056809 1.97282532 3.04633375 4.01593744 5.02027216], F(w) = 0.37931126038585133
iteration 84: w = [1.09056836 1.97282788 3.0463311  4.01593078 5.02026725], F(w) = 0.37931996820583913
iteration 85: w = [1.09056863 1.97283039 3.04632851 4.01592428 5.02026245], F(w) = 0.37932847567629935
iteration 86: w = [1.0905689  1.97283283 3.04632597 4.01591793 5.02025775], F(w) = 0.37933678963372147
iteration 87: w = [1.09056916 1.97283523 3.0463235  4.01591172 5.02025317], F(w) = 0.37934491660700986
iteration 88: w = [1.09056942 1.97283757 3.04632108 4.01590564 5.02024869], F(w) = 0.3793528628346459
iteration 89: w = [1.09056967 1.97283985 3.04631871 4.01589971 5.0202443 ], F(w) = 0.3793606342806174
iteration 90: w = [1.09056992 1.97284209 3.04631639 4.01589389 5.02024001], F(w) = 0.379368236649392
iteration 91: w = [1.09057016 1.97284428 3.04631412 4.01588821 5.02023582], F(w) = 0.37937567539983047
iteration 92: w = [1.0905704  1.97284642 3.0463119  4.01588265 5.02023171], F(w) = 0.37938295575829506
iteration 93: w = [1.09057064 1.97284852 3.04630973 4.0158772  5.0202277 ], F(w) = 0.37939008273091956
iteration 94: w = [1.09057087 1.97285057 3.0463076  4.01587186 5.02022376], F(w) = 0.3793970611150642
iteration 95: w = [1.0905711  1.97285258 3.04630552 4.01586664 5.02021991], F(w) = 0.3794038955100623
iteration 96: w = [1.09057132 1.97285455 3.04630348 4.01586152 5.02021613], F(w) = 0.37941059032738184
iteration 97: w = [1.09057155 1.97285648 3.04630148 4.01585651 5.02021244], F(w) = 0.37941714980005437
iteration 98: w = [1.09057176 1.97285837 3.04629952 4.0158516  5.02020881], F(w) = 0.3794235779916966
iteration 99: w = [1.09057198 1.97286022 3.0462976  4.01584678 5.02020526], F(w) = 0.3794298788048349
iteration 100: w = [1.09057219 1.97286203 3.04629571 4.01584206 5.02020178], F(w) = 0.37943605598883756
iteration 101: w = [1.09057239 1.97286381 3.04629387 4.01583743 5.02019837], F(w) = 0.3794421131473322
iteration 102: w = [1.0905726  1.97286556 3.04629206 4.01583289 5.02019502], F(w) = 0.3794480537452354
iteration 103: w = [1.0905728  1.97286727 3.04629028 4.01582843 5.02019174], F(w) = 0.3794538811153693
iteration 104: w = [1.090573   1.97286895 3.04628854 4.01582406 5.02018852], F(w) = 0.37945959846469646
iteration 105: w = [1.09057319 1.9728706  3.04628682 4.01581977 5.02018536], F(w) = 0.37946520888016216
iteration 106: w = [1.09057338 1.97287222 3.04628515 4.01581556 5.02018226], F(w) = 0.3794707153343297
iteration 107: w = [1.09057357 1.9728738  3.0462835  4.01581143 5.02017921], F(w) = 0.3794761206905905
iteration 108: w = [1.09057376 1.97287536 3.04628188 4.01580737 5.02017623], F(w) = 0.3794814277080982
iteration 109: w = [1.09057394 1.97287689 3.04628029 4.01580339 5.02017329], F(w) = 0.37948663904655616
iteration 110: w = [1.09057412 1.97287839 3.04627873 4.01579948 5.02017041], F(w) = 0.3794917572705584
iteration 111: w = [1.0905743  1.97287987 3.0462772  4.01579563 5.02016758], F(w) = 0.37949678485388805
iteration 112: w = [1.09057447 1.97288132 3.04627569 4.01579186 5.0201648 ], F(w) = 0.3795017241834364
iteration 113: w = [1.09057465 1.97288274 3.04627421 4.01578815 5.02016206], F(w) = 0.37950657756302536
iteration 114: w = [1.09057482 1.97288414 3.04627275 4.0157845  5.02015938], F(w) = 0.37951134721699226
iteration 115: w = [1.09057499 1.97288552 3.04627132 4.01578092 5.02015674], F(w) = 0.3795160352935358
iteration 116: w = [1.09057515 1.97288687 3.04626992 4.01577739 5.02015415], F(w) = 0.3795206438680206
iteration 117: w = [1.09057531 1.9728882  3.04626854 4.01577393 5.0201516 ], F(w) = 0.3795251749459798
iteration 118: w = [1.09057547 1.97288951 3.04626718 4.01577052 5.02014909], F(w) = 0.37952963046605487
iteration 119: w = [1.09057563 1.97289079 3.04626584 4.01576717 5.02014662], F(w) = 0.37953401230277223
iteration 120: w = [1.09057579 1.97289205 3.04626453 4.01576388 5.0201442 ], F(w) = 0.37953832226911566
iteration 121: w = [1.09057594 1.9728933  3.04626323 4.01576063 5.02014181], F(w) = 0.3795425621191142
iteration 122: w = [1.0905761  1.97289452 3.04626196 4.01575744 5.02013946], F(w) = 0.37954673355017654
iteration 123: w = [1.09057625 1.97289572 3.04626071 4.01575431 5.02013715], F(w) = 0.3795508382053268
iteration 124: w = [1.09057639 1.97289691 3.04625948 4.01575122 5.02013488], F(w) = 0.3795548776754288
iteration 125: w = [1.09057654 1.97289807 3.04625826 4.01574818 5.02013265], F(w) = 0.3795588535011551
iteration 126: w = [1.09057668 1.97289922 3.04625707 4.01574518 5.02013044], F(w) = 0.37956276717506715
iteration 127: w = [1.09057682 1.97290035 3.04625589 4.01574224 5.02012828], F(w) = 0.3795666201433902
iteration 128: w = [1.09057697 1.97290146 3.04625474 4.01573934 5.02012614], F(w) = 0.3795704138078176
iteration 129: w = [1.0905771  1.97290256 3.0462536  4.01573648 5.02012404], F(w) = 0.37957414952719926
iteration 130: w = [1.09057724 1.97290363 3.04625248 4.01573367 5.02012197], F(w) = 0.3795778286192451
iteration 131: w = [1.09057737 1.9729047  3.04625137 4.0157309  5.02011993], F(w) = 0.3795814523619411
iteration 132: w = [1.09057751 1.97290574 3.04625028 4.01572817 5.02011793], F(w) = 0.3795850219951133
iteration 133: w = [1.09057764 1.97290677 3.04624921 4.01572548 5.02011595], F(w) = 0.379588538721858
iteration 134: w = [1.09057777 1.97290779 3.04624815 4.01572283 5.020114  ], F(w) = 0.3795920037098476
iteration 135: w = [1.0905779  1.97290879 3.04624711 4.01572022 5.02011208], F(w) = 0.3795954180926565
iteration 136: w = [1.09057802 1.97290977 3.04624608 4.01571764 5.02011019], F(w) = 0.3795987829709613
iteration 137: w = [1.09057815 1.97291074 3.04624507 4.01571511 5.02010832], F(w) = 0.3796020994137685
iteration 138: w = [1.09057827 1.9729117  3.04624407 4.01571261 5.02010648], F(w) = 0.3796053684595041
iteration 139: w = [1.09057839 1.97291264 3.04624309 4.01571014 5.02010467], F(w) = 0.37960859111713313
iteration 140: w = [1.09057851 1.97291357 3.04624212 4.01570771 5.02010289], F(w) = 0.37961176836717736
iteration 141: w = [1.09057863 1.97291449 3.04624117 4.01570531 5.02010112], F(w) = 0.3796149011627011
iteration 142: w = [1.09057875 1.9729154  3.04624022 4.01570295 5.02009939], F(w) = 0.37961799043031286
iteration 143: w = [1.09057887 1.97291629 3.04623929 4.01570062 5.02009767], F(w) = 0.3796210370710341
iteration 144: w = [1.09057898 1.97291717 3.04623838 4.01569832 5.02009599], F(w) = 0.37962404196115557
iteration 145: w = [1.09057909 1.97291803 3.04623747 4.01569606 5.02009432], F(w) = 0.37962700595316723
iteration 146: w = [1.09057921 1.97291889 3.04623658 4.01569382 5.02009268], F(w) = 0.37962992987646466
iteration 147: w = [1.09057932 1.97291973 3.0462357  4.01569161 5.02009105], F(w) = 0.37963281453817344
iteration 148: w = [1.09057943 1.97292057 3.04623483 4.01568944 5.02008945], F(w) = 0.3796356607238837
iteration 149: w = [1.09057953 1.97292139 3.04623397 4.01568729 5.02008788], F(w) = 0.3796384691983607
iteration 150: w = [1.09057964 1.9729222  3.04623313 4.01568517 5.02008632], F(w) = 0.3796412407062665
iteration 151: w = [1.09057975 1.972923   3.04623229 4.01568308 5.02008478], F(w) = 0.3796439759727534
iteration 152: w = [1.09057985 1.97292379 3.04623147 4.01568101 5.02008326], F(w) = 0.37964667570413346
iteration 153: w = [1.09057995 1.97292457 3.04623066 4.01567897 5.02008177], F(w) = 0.37964934058849453
iteration 154: w = [1.09058005 1.97292534 3.04622985 4.01567696 5.02008029], F(w) = 0.37965197129625516
iteration 155: w = [1.09058016 1.9729261  3.04622906 4.01567497 5.02007883], F(w) = 0.37965456848074575
iteration 156: w = [1.09058026 1.97292685 3.04622828 4.01567301 5.02007739], F(w) = 0.37965713277874785
iteration 157: w = [1.09058035 1.97292759 3.04622751 4.01567108 5.02007596], F(w) = 0.3796596648110627
iteration 158: w = [1.09058045 1.97292832 3.04622674 4.01566916 5.02007456], F(w) = 0.3796621651828971
iteration 159: w = [1.09058055 1.97292904 3.04622599 4.01566727 5.02007317], F(w) = 0.37966463448444715
iteration 160: w = [1.09058064 1.97292976 3.04622525 4.01566541 5.0200718 ], F(w) = 0.3796670732913173
iteration 161: w = [1.09058074 1.97293046 3.04622451 4.01566357 5.02007045], F(w) = 0.3796694821650024
iteration 162: w = [1.09058083 1.97293116 3.04622379 4.01566175 5.02006911], F(w) = 0.3796718616532769
iteration 163: w = [1.09058092 1.97293184 3.04622307 4.01565995 5.02006779], F(w) = 0.379674212290619
iteration 164: w = [1.09058101 1.97293252 3.04622236 4.01565817 5.02006649], F(w) = 0.379676534598656
iteration 165: w = [1.0905811  1.97293319 3.04622166 4.01565642 5.0200652 ], F(w) = 0.37967882908649114
iteration 166: w = [1.09058119 1.97293386 3.04622097 4.01565468 5.02006392], F(w) = 0.37968109625111873
iteration 167: w = [1.09058128 1.97293451 3.04622028 4.01565297 5.02006266], F(w) = 0.37968333657772746
iteration 168: w = [1.09058137 1.97293516 3.04621961 4.01565127 5.02006142], F(w) = 0.37968555054012126
iteration 169: w = [1.09058146 1.9729358  3.04621894 4.0156496  5.02006019], F(w) = 0.37968773860101024
iteration 170: w = [1.09058154 1.97293643 3.04621828 4.01564795 5.02005898], F(w) = 0.3796899012123264
iteration 171: w = [1.09058163 1.97293706 3.04621763 4.01564631 5.02005778], F(w) = 0.3796920388155422
iteration 172: w = [1.09058171 1.97293767 3.04621698 4.01564469 5.02005659], F(w) = 0.3796941518420018
iteration 173: w = [1.09058179 1.97293828 3.04621635 4.0156431  5.02005542], F(w) = 0.3796962407131822
iteration 174: w = [1.09058188 1.97293889 3.04621572 4.01564152 5.02005426], F(w) = 0.37969830584097025
iteration 175: w = [1.09058196 1.97293948 3.04621509 4.01563995 5.02005311], F(w) = 0.3797003476279323
iteration 176: w = [1.09058204 1.97294007 3.04621448 4.01563841 5.02005198], F(w) = 0.3797023664675969
iteration 177: w = [1.09058212 1.97294066 3.04621387 4.01563688 5.02005085], F(w) = 0.3797043627446883
iteration 178: w = [1.0905822  1.97294123 3.04621326 4.01563537 5.02004975], F(w) = 0.3797063368353727
iteration 179: w = [1.09058227 1.9729418  3.04621267 4.01563388 5.02004865], F(w) = 0.37970828910750115
iteration 180: w = [1.09058235 1.97294237 3.04621208 4.0156324  5.02004756], F(w) = 0.37971021992085763
iteration 181: w = [1.09058243 1.97294293 3.0462115  4.01563094 5.02004649], F(w) = 0.3797121296273407
iteration 182: w = [1.0905825  1.97294348 3.04621092 4.01562949 5.02004543], F(w) = 0.379714018571206
iteration 183: w = [1.09058258 1.97294402 3.04621035 4.01562807 5.02004438], F(w) = 0.37971588708922965
iteration 184: w = [1.09058265 1.97294456 3.04620979 4.01562665 5.02004334], F(w) = 0.37971773551098453
iteration 185: w = [1.09058273 1.9729451  3.04620923 4.01562525 5.02004232], F(w) = 0.3797195641589794
iteration 186: w = [1.0905828  1.97294563 3.04620867 4.01562387 5.0200413 ], F(w) = 0.3797213733488666
iteration 187: w = [1.09058287 1.97294615 3.04620813 4.0156225  5.0200403 ], F(w) = 0.37972316338957646
iteration 188: w = [1.09058294 1.97294667 3.04620759 4.01562114 5.0200393 ], F(w) = 0.3797249345835692
iteration 189: w = [1.09058301 1.97294718 3.04620705 4.0156198  5.02003832], F(w) = 0.37972668722697783
iteration 190: w = [1.09058308 1.97294768 3.04620652 4.01561847 5.02003734], F(w) = 0.3797284216097186
iteration 191: w = [1.09058315 1.97294819 3.046206   4.01561716 5.02003638], F(w) = 0.3797301380157265
iteration 192: w = [1.09058322 1.97294868 3.04620548 4.01561586 5.02003543], F(w) = 0.3797318367230862
iteration 193: w = [1.09058329 1.97294917 3.04620497 4.01561458 5.02003448], F(w) = 0.3797335180041797
iteration 194: w = [1.09058336 1.97294966 3.04620446 4.0156133  5.02003355], F(w) = 0.37973518212578267
iteration 195: w = [1.09058343 1.97295014 3.04620396 4.01561204 5.02003262], F(w) = 0.379736829349304
iteration 196: w = [1.09058349 1.97295062 3.04620346 4.01561079 5.02003171], F(w) = 0.37973845993086003
iteration 197: w = [1.09058356 1.97295109 3.04620297 4.01560956 5.0200308 ], F(w) = 0.37974007412139726
iteration 198: w = [1.09058362 1.97295155 3.04620248 4.01560834 5.0200299 ], F(w) = 0.3797416721668572
iteration 199: w = [1.09058369 1.97295202 3.046202   4.01560712 5.02002902], F(w) = 0.3797432543082796
iteration 200: w = [1.09058375 1.97295247 3.04620152 4.01560593 5.02002814], F(w) = 0.3797448207819068
iteration 201: w = [1.09058382 1.97295293 3.04620104 4.01560474 5.02002727], F(w) = 0.3797463718193759
iteration 202: w = [1.09058388 1.97295337 3.04620058 4.01560356 5.0200264 ], F(w) = 0.37974790764775335
iteration 203: w = [1.09058394 1.97295382 3.04620011 4.0156024  5.02002555], F(w) = 0.37974942848964627
iteration 204: w = [1.090584   1.97295426 3.04619965 4.01560125 5.0200247 ], F(w) = 0.3797509345633868
iteration 205: w = [1.09058406 1.97295469 3.0461992  4.01560011 5.02002387], F(w) = 0.37975242608304804
iteration 206: w = [1.09058412 1.97295512 3.04619875 4.01559898 5.02002304], F(w) = 0.3797539032586116
iteration 207: w = [1.09058418 1.97295555 3.0461983  4.01559786 5.02002222], F(w) = 0.3797553662960375
iteration 208: w = [1.09058424 1.97295597 3.04619786 4.01559675 5.0200214 ], F(w) = 0.3797568153973353
iteration 209: w = [1.0905843  1.97295639 3.04619742 4.01559565 5.0200206 ], F(w) = 0.3797582507606977
iteration 210: w = [1.09058436 1.97295681 3.04619698 4.01559456 5.0200198 ], F(w) = 0.3797596725806129
iteration 211: w = [1.09058442 1.97295722 3.04619655 4.01559348 5.02001901], F(w) = 0.3797610810478353
iteration 212: w = [1.09058448 1.97295763 3.04619613 4.01559242 5.02001823], F(w) = 0.3797624763496336
iteration 213: w = [1.09058453 1.97295803 3.04619571 4.01559136 5.02001745], F(w) = 0.37976385866974854
iteration 214: w = [1.09058459 1.97295843 3.04619529 4.01559031 5.02001668], F(w) = 0.37976522818852687
iteration 215: w = [1.09058465 1.97295882 3.04619487 4.01558927 5.02001592], F(w) = 0.379766585082994
iteration 216: w = [1.0905847  1.97295922 3.04619446 4.01558824 5.02001516], F(w) = 0.37976792952691496
iteration 217: w = [1.09058476 1.97295961 3.04619406 4.01558722 5.02001442], F(w) = 0.37976926169089636
iteration 218: w = [1.09058481 1.97295999 3.04619365 4.01558621 5.02001368], F(w) = 0.37977058174241146
iteration 219: w = [1.09058487 1.97296037 3.04619326 4.01558521 5.02001294], F(w) = 0.3797718898459422
iteration 220: w = [1.09058492 1.97296075 3.04619286 4.01558422 5.02001221], F(w) = 0.37977318616297406
iteration 221: w = [1.09058497 1.97296113 3.04619247 4.01558324 5.02001149], F(w) = 0.37977447085212596
iteration 222: w = [1.09058503 1.9729615  3.04619208 4.01558226 5.02001078], F(w) = 0.37977574406915143
iteration 223: w = [1.09058508 1.97296187 3.04619169 4.0155813  5.02001007], F(w) = 0.37977700596704705
iteration 224: w = [1.09058513 1.97296223 3.04619131 4.01558034 5.02000937], F(w) = 0.37977825669608817
iteration 225: w = [1.09058518 1.97296259 3.04619093 4.01557939 5.02000867], F(w) = 0.3797794964039388
iteration 226: w = [1.09058523 1.97296295 3.04619056 4.01557845 5.02000798], F(w) = 0.37978072523562606
iteration 227: w = [1.09058528 1.97296331 3.04619019 4.01557752 5.0200073 ], F(w) = 0.3797819433337001
iteration 228: w = [1.09058534 1.97296366 3.04618982 4.01557659 5.02000662], F(w) = 0.379783150838165
iteration 229: w = [1.09058539 1.97296401 3.04618945 4.01557568 5.02000595], F(w) = 0.37978434788665294
iteration 230: w = [1.09058543 1.97296435 3.04618909 4.01557477 5.02000528], F(w) = 0.3797855346143747
iteration 231: w = [1.09058548 1.9729647  3.04618873 4.01557387 5.02000462], F(w) = 0.3797867111542359
iteration 232: w = [1.09058553 1.97296504 3.04618837 4.01557298 5.02000397], F(w) = 0.37978787763690564
iteration 233: w = [1.09058558 1.97296537 3.04618802 4.01557209 5.02000332], F(w) = 0.37978903419078286
iteration 234: w = [1.09058563 1.97296571 3.04618767 4.01557121 5.02000268], F(w) = 0.37979018094212413
iteration 235: w = [1.09058568 1.97296604 3.04618732 4.01557034 5.02000204], F(w) = 0.37979131801501853
iteration 236: w = [1.09058572 1.97296637 3.04618698 4.01556948 5.02000141], F(w) = 0.379792445531508
iteration 237: w = [1.09058577 1.97296669 3.04618664 4.01556862 5.02000078], F(w) = 0.37979356361156336
iteration 238: w = [1.09058582 1.97296702 3.0461863  4.01556777 5.02000016], F(w) = 0.3797946723731651
iteration 239: w = [1.09058586 1.97296734 3.04618597 4.01556693 5.01999954], F(w) = 0.3797957719323341
iteration 240: w = [1.09058591 1.97296766 3.04618563 4.0155661  5.01999893], F(w) = 0.37979686240317984
iteration 241: w = [1.09058596 1.97296797 3.0461853  4.01556527 5.01999832], F(w) = 0.37979794389792537
iteration 242: w = [1.090586   1.97296828 3.04618497 4.01556445 5.01999772], F(w) = 0.37979901652694686
iteration 243: w = [1.09058605 1.97296859 3.04618465 4.01556364 5.01999712], F(w) = 0.3798000803988337
iteration 244: w = [1.09058609 1.9729689  3.04618433 4.01556283 5.01999653], F(w) = 0.3798011356203775
iteration 245: w = [1.09058613 1.97296921 3.04618401 4.01556203 5.01999594], F(w) = 0.3798021822966959
iteration 246: w = [1.09058618 1.97296951 3.04618369 4.01556123 5.01999536], F(w) = 0.37980322053115906
iteration 247: w = [1.09058622 1.97296981 3.04618338 4.01556044 5.01999478], F(w) = 0.37980425042549487
iteration 248: w = [1.09058626 1.97297011 3.04618306 4.01555966 5.01999421], F(w) = 0.3798052720797942
iteration 249: w = [1.09058631 1.9729704  3.04618276 4.01555889 5.01999364], F(w) = 0.37980628559260193
iteration 250: w = [1.09058635 1.9729707  3.04618245 4.01555812 5.01999308], F(w) = 0.3798072910608194
iteration 251: w = [1.09058639 1.97297099 3.04618214 4.01555735 5.01999252], F(w) = 0.37980828857987087
iteration 252: w = [1.09058643 1.97297128 3.04618184 4.01555659 5.01999196], F(w) = 0.3798092782436574
iteration 253: w = [1.09058648 1.97297156 3.04618154 4.01555584 5.01999141], F(w) = 0.3798102601446193
iteration 254: w = [1.09058652 1.97297185 3.04618124 4.0155551  5.01999086], F(w) = 0.3798112343737187
iteration 255: w = [1.09058656 1.97297213 3.04618095 4.01555436 5.01999032], F(w) = 0.37981220102054003
iteration 256: w = [1.0905866  1.97297241 3.04618066 4.01555362 5.01998978], F(w) = 0.3798131601732704
iteration 257: w = [1.09058664 1.97297268 3.04618037 4.01555289 5.01998925], F(w) = 0.37981411191872266
iteration 258: w = [1.09058668 1.97297296 3.04618008 4.01555217 5.01998872], F(w) = 0.37981505634238344
iteration 259: w = [1.09058672 1.97297323 3.04617979 4.01555145 5.01998819], F(w) = 0.3798159935284241
iteration 260: w = [1.09058676 1.9729735  3.04617951 4.01555074 5.01998767], F(w) = 0.37981692355973573
iteration 261: w = [1.0905868  1.97297377 3.04617923 4.01555004 5.01998715], F(w) = 0.37981784651793804
iteration 262: w = [1.09058684 1.97297404 3.04617895 4.01554933 5.01998664], F(w) = 0.3798187624834196
iteration 263: w = [1.09058688 1.97297431 3.04617867 4.01554864 5.01998613], F(w) = 0.3798196715353676
iteration 264: w = [1.09058691 1.97297457 3.04617839 4.01554795 5.01998562], F(w) = 0.37982057375175343
iteration 265: w = [1.09058695 1.97297483 3.04617812 4.01554726 5.01998512], F(w) = 0.37982146920940074
iteration 266: w = [1.09058699 1.97297509 3.04617785 4.01554658 5.01998462], F(w) = 0.379822357983982
iteration 267: w = [1.09058703 1.97297535 3.04617758 4.01554591 5.01998413], F(w) = 0.37982324015003044
iteration 268: w = [1.09058707 1.9729756  3.04617731 4.01554524 5.01998364], F(w) = 0.3798241157810006
iteration 269: w = [1.0905871  1.97297585 3.04617705 4.01554457 5.01998315], F(w) = 0.3798249849492438
iteration 270: w = [1.09058714 1.9729761  3.04617678 4.01554391 5.01998267], F(w) = 0.37982584772605443
iteration 271: w = [1.09058718 1.97297635 3.04617652 4.01554326 5.01998219], F(w) = 0.379826704181673
iteration 272: w = [1.09058721 1.9729766  3.04617626 4.0155426  5.01998171], F(w) = 0.37982755438533017
iteration 273: w = [1.09058725 1.97297685 3.046176   4.01554196 5.01998124], F(w) = 0.3798283984052201
iteration 274: w = [1.09058728 1.97297709 3.04617575 4.01554132 5.01998077], F(w) = 0.3798292363085688
iteration 275: w = [1.09058732 1.97297733 3.04617549 4.01554068 5.0199803 ], F(w) = 0.37983006816164233
iteration 276: w = [1.09058736 1.97297758 3.04617524 4.01554005 5.01997984], F(w) = 0.3798308940297451
iteration 277: w = [1.09058739 1.97297781 3.04617499 4.01553942 5.01997938], F(w) = 0.3798317139772371
iteration 278: w = [1.09058743 1.97297805 3.04617474 4.0155388  5.01997892], F(w) = 0.3798325280675579
iteration 279: w = [1.09058746 1.97297829 3.0461745  4.01553818 5.01997847], F(w) = 0.3798333363632532
iteration 280: w = [1.0905875  1.97297852 3.04617425 4.01553756 5.01997802], F(w) = 0.3798341389259582
iteration 281: w = [1.09058753 1.97297875 3.04617401 4.01553695 5.01997757], F(w) = 0.3798349358164654
iteration 282: w = [1.09058756 1.97297898 3.04617377 4.01553635 5.01997712], F(w) = 0.3798357270947128
iteration 283: w = [1.0905876  1.97297921 3.04617353 4.01553575 5.01997668], F(w) = 0.37983651281978265
iteration 284: w = [1.09058763 1.97297944 3.04617329 4.01553515 5.01997625], F(w) = 0.3798372930499232
iteration 285: w = [1.09058766 1.97297967 3.04617305 4.01553456 5.01997581], F(w) = 0.37983806784258733
iteration 286: w = [1.0905877  1.97297989 3.04617282 4.01553397 5.01997538], F(w) = 0.37983883725442563
iteration 287: w = [1.09058773 1.97298011 3.04617258 4.01553338 5.01997495], F(w) = 0.37983960134130423
iteration 288: w = [1.09058776 1.97298033 3.04617235 4.0155328  5.01997453], F(w) = 0.3798403601583056
iteration 289: w = [1.0905878  1.97298055 3.04617212 4.01553222 5.0199741 ], F(w) = 0.37984111375977353
iteration 290: w = [1.09058783 1.97298077 3.04617189 4.01553165 5.01997368], F(w) = 0.3798418621992925
iteration 291: w = [1.09058786 1.97298099 3.04617167 4.01553108 5.01997327], F(w) = 0.3798426055297236
iteration 292: w = [1.09058789 1.9729812  3.04617144 4.01553052 5.01997285], F(w) = 0.3798433438032209
iteration 293: w = [1.09058792 1.97298142 3.04617122 4.01552996 5.01997244], F(w) = 0.3798440770712075
iteration 294: w = [1.09058795 1.97298163 3.04617099 4.0155294  5.01997203], F(w) = 0.37984480538441384
iteration 295: w = [1.09058799 1.97298184 3.04617077 4.01552884 5.01997163], F(w) = 0.37984552879289296
iteration 296: w = [1.09058802 1.97298205 3.04617055 4.01552829 5.01997122], F(w) = 0.3798462473460358
iteration 297: w = [1.09058805 1.97298226 3.04617034 4.01552775 5.01997082], F(w) = 0.3798469610925679
iteration 298: w = [1.09058808 1.97298246 3.04617012 4.0155272  5.01997043], F(w) = 0.3798476700805605
iteration 299: w = [1.09058811 1.97298267 3.04616991 4.01552667 5.01997003], F(w) = 0.3798483743574259
iteration 300: w = [1.09058814 1.97298287 3.04616969 4.01552613 5.01996964], F(w) = 0.37984907396999446
iteration 301: w = [1.09058817 1.97298307 3.04616948 4.0155256  5.01996925], F(w) = 0.379849768964456
iteration 302: w = [1.0905882  1.97298327 3.04616927 4.01552507 5.01996886], F(w) = 0.379850459386367
iteration 303: w = [1.09058823 1.97298347 3.04616906 4.01552454 5.01996848], F(w) = 0.3798511452807148
iteration 304: w = [1.09058826 1.97298367 3.04616885 4.01552402 5.0199681 ], F(w) = 0.3798518266919033
iteration 305: w = [1.09058829 1.97298387 3.04616864 4.0155235  5.01996772], F(w) = 0.3798525036637523
iteration 306: w = [1.09058832 1.97298407 3.04616844 4.01552299 5.01996734], F(w) = 0.3798531762394762
iteration 307: w = [1.09058835 1.97298426 3.04616824 4.01552248 5.01996696], F(w) = 0.3798538444617947
iteration 308: w = [1.09058838 1.97298445 3.04616803 4.01552197 5.01996659], F(w) = 0.3798545083728215
iteration 309: w = [1.0905884  1.97298465 3.04616783 4.01552146 5.01996622], F(w) = 0.37985516801415564
iteration 310: w = [1.09058843 1.97298484 3.04616763 4.01552096 5.01996585], F(w) = 0.3798558234268558
iteration 311: w = [1.09058846 1.97298503 3.04616743 4.01552046 5.01996549], F(w) = 0.3798564746514552
iteration 312: w = [1.09058849 1.97298521 3.04616723 4.01551997 5.01996513], F(w) = 0.37985712172797387
iteration 313: w = [1.09058852 1.9729854  3.04616704 4.01551948 5.01996477], F(w) = 0.3798577646959207
iteration 314: w = [1.09058855 1.97298559 3.04616684 4.01551899 5.01996441], F(w) = 0.379858403594299
iteration 315: w = [1.09058857 1.97298577 3.04616665 4.0155185  5.01996405], F(w) = 0.37985903846164926
iteration 316: w = [1.0905886  1.97298596 3.04616646 4.01551802 5.0199637 ], F(w) = 0.3798596693359669
iteration 317: w = [1.09058863 1.97298614 3.04616627 4.01551754 5.01996335], F(w) = 0.3798602962548248
iteration 318: w = [1.09058865 1.97298632 3.04616607 4.01551706 5.019963  ], F(w) = 0.37986091925531995
iteration 319: w = [1.09058868 1.9729865  3.04616589 4.01551659 5.01996265], F(w) = 0.3798615383740721
iteration 320: w = [1.09058871 1.97298668 3.0461657  4.01551611 5.0199623 ], F(w) = 0.37986215364725123
iteration 321: w = [1.09058874 1.97298686 3.04616551 4.01551565 5.01996196], F(w) = 0.3798627651105786
iteration 322: w = [1.09058876 1.97298703 3.04616533 4.01551518 5.01996162], F(w) = 0.37986337279932564
iteration 323: w = [1.09058879 1.97298721 3.04616514 4.01551472 5.01996128], F(w) = 0.37986397674833816
iteration 324: w = [1.09058881 1.97298739 3.04616496 4.01551426 5.01996095], F(w) = 0.37986457699205267
iteration 325: w = [1.09058884 1.97298756 3.04616478 4.0155138  5.01996061], F(w) = 0.3798651735644349
iteration 326: w = [1.09058887 1.97298773 3.04616459 4.01551335 5.01996028], F(w) = 0.3798657664991017
iteration 327: w = [1.09058889 1.9729879  3.04616441 4.0155129  5.01995995], F(w) = 0.3798663558291914
iteration 328: w = [1.09058892 1.97298807 3.04616424 4.01551245 5.01995962], F(w) = 0.3798669415875067
iteration 329: w = [1.09058894 1.97298824 3.04616406 4.015512   5.01995929], F(w) = 0.37986752380641553
iteration 330: w = [1.09058897 1.97298841 3.04616388 4.01551156 5.01995897], F(w) = 0.37986810251788866
iteration 331: w = [1.09058899 1.97298858 3.04616371 4.01551112 5.01995865], F(w) = 0.37986867775355426
iteration 332: w = [1.09058902 1.97298875 3.04616353 4.01551068 5.01995833], F(w) = 0.3798692495445984
iteration 333: w = [1.09058904 1.97298891 3.04616336 4.01551025 5.01995801], F(w) = 0.37986981792190294
iteration 334: w = [1.09058907 1.97298908 3.04616319 4.01550981 5.01995769], F(w) = 0.37987038291592384
iteration 335: w = [1.09058909 1.97298924 3.04616301 4.01550938 5.01995737], F(w) = 0.3798709445568032
iteration 336: w = [1.09058912 1.9729894  3.04616284 4.01550896 5.01995706], F(w) = 0.37987150287430754
iteration 337: w = [1.09058914 1.97298956 3.04616267 4.01550853 5.01995675], F(w) = 0.37987205789784234
iteration 338: w = [1.09058917 1.97298972 3.04616251 4.01550811 5.01995644], F(w) = 0.37987260965647374
iteration 339: w = [1.09058919 1.97298988 3.04616234 4.01550769 5.01995613], F(w) = 0.3798731581789242
iteration 340: w = [1.09058921 1.97299004 3.04616217 4.01550727 5.01995583], F(w) = 0.37987370349359345
iteration 341: w = [1.09058924 1.9729902  3.04616201 4.01550686 5.01995552], F(w) = 0.37987424562854294
iteration 342: w = [1.09058926 1.97299036 3.04616184 4.01550644 5.01995522], F(w) = 0.37987478461148166
iteration 343: w = [1.09058929 1.97299051 3.04616168 4.01550603 5.01995492], F(w) = 0.3798753204698277
iteration 344: w = [1.09058931 1.97299067 3.04616151 4.01550562 5.01995462], F(w) = 0.37987585323068584
iteration 345: w = [1.09058933 1.97299082 3.04616135 4.01550522 5.01995433], F(w) = 0.37987638292084147
iteration 346: w = [1.09058936 1.97299097 3.04616119 4.01550482 5.01995403], F(w) = 0.3798769095667517
iteration 347: w = [1.09058938 1.97299113 3.04616103 4.01550441 5.01995374], F(w) = 0.3798774331946086
iteration 348: w = [1.0905894  1.97299128 3.04616087 4.01550402 5.01995344], F(w) = 0.3798779538302531
iteration 349: w = [1.09058942 1.97299143 3.04616072 4.01550362 5.01995315], F(w) = 0.3798784714992742
iteration 350: w = [1.09058945 1.97299158 3.04616056 4.01550323 5.01995287], F(w) = 0.3798789862269623
iteration 351: w = [1.09058947 1.97299173 3.0461604  4.01550283 5.01995258], F(w) = 0.3798794980383342
iteration 352: w = [1.09058949 1.97299188 3.04616025 4.01550244 5.01995229], F(w) = 0.3798800069580936
iteration 353: w = [1.09058951 1.97299202 3.04616009 4.01550206 5.01995201], F(w) = 0.37988051301065073
iteration 354: w = [1.09058954 1.97299217 3.04615994 4.01550167 5.01995173], F(w) = 0.37988101622021153
iteration 355: w = [1.09058956 1.97299232 3.04615979 4.01550129 5.01995145], F(w) = 0.3798815166106456
iteration 356: w = [1.09058958 1.97299246 3.04615963 4.01550091 5.01995117], F(w) = 0.379882014205582
iteration 357: w = [1.0905896  1.9729926  3.04615948 4.01550053 5.01995089], F(w) = 0.37988250902838255
iteration 358: w = [1.09058962 1.97299275 3.04615933 4.01550015 5.01995061], F(w) = 0.3798830011021476
iteration 359: w = [1.09058965 1.97299289 3.04615918 4.01549978 5.01995034], F(w) = 0.37988349044972247
iteration 360: w = [1.09058967 1.97299303 3.04615903 4.0154994  5.01995007], F(w) = 0.3798839770937073
iteration 361: w = [1.09058969 1.97299317 3.04615889 4.01549903 5.0199498 ], F(w) = 0.37988446105646034
iteration 362: w = [1.09058971 1.97299331 3.04615874 4.01549866 5.01994953], F(w) = 0.3798849423600532
iteration 363: w = [1.09058973 1.97299345 3.04615859 4.0154983  5.01994926], F(w) = 0.37988542102637346
iteration 364: w = [1.09058975 1.97299359 3.04615845 4.01549793 5.01994899], F(w) = 0.3798858970770111
iteration 365: w = [1.09058977 1.97299373 3.0461583  4.01549757 5.01994873], F(w) = 0.3798863705333678
iteration 366: w = [1.09058979 1.97299387 3.04615816 4.01549721 5.01994846], F(w) = 0.37988684141658924
iteration 367: w = [1.09058981 1.972994   3.04615802 4.01549685 5.0199482 ], F(w) = 0.37988730974760637
iteration 368: w = [1.09058984 1.97299414 3.04615787 4.01549649 5.01994794], F(w) = 0.37988777554708986
iteration 369: w = [1.09058986 1.97299427 3.04615773 4.01549614 5.01994768], F(w) = 0.37988823883552203
iteration 370: w = [1.09058988 1.97299441 3.04615759 4.01549579 5.01994742], F(w) = 0.379888699633151
iteration 371: w = [1.0905899  1.97299454 3.04615745 4.01549544 5.01994716], F(w) = 0.37988915796002787
iteration 372: w = [1.09058992 1.97299467 3.04615731 4.01549509 5.01994691], F(w) = 0.37988961383594877
iteration 373: w = [1.09058994 1.9729948  3.04615717 4.01549474 5.01994665], F(w) = 0.3798900672805543
iteration 374: w = [1.09058996 1.97299493 3.04615704 4.01549439 5.0199464 ], F(w) = 0.37989051831322146
iteration 375: w = [1.09058998 1.97299507 3.0461569  4.01549405 5.01994615], F(w) = 0.3798909669531509
iteration 376: w = [1.09059    1.9729952  3.04615676 4.01549371 5.0199459 ], F(w) = 0.37989141321932546
iteration 377: w = [1.09059002 1.97299532 3.04615663 4.01549337 5.01994565], F(w) = 0.379891857130542
iteration 378: w = [1.09059004 1.97299545 3.04615649 4.01549303 5.0199454 ], F(w) = 0.3798922987053993
iteration 379: w = [1.09059006 1.97299558 3.04615636 4.01549269 5.01994516], F(w) = 0.3798927379622957
iteration 380: w = [1.09059008 1.97299571 3.04615623 4.01549236 5.01994491], F(w) = 0.37989317491942826
iteration 381: w = [1.09059009 1.97299583 3.04615609 4.01549203 5.01994467], F(w) = 0.37989360959481666
iteration 382: w = [1.09059011 1.97299596 3.04615596 4.0154917  5.01994442], F(w) = 0.37989404200628146
iteration 383: w = [1.09059013 1.97299609 3.04615583 4.01549137 5.01994418], F(w) = 0.3798944721714692
iteration 384: w = [1.09059015 1.97299621 3.0461557  4.01549104 5.01994394], F(w) = 0.37989490010783805
iteration 385: w = [1.09059017 1.97299633 3.04615557 4.01549071 5.0199437 ], F(w) = 0.3798953258326646
iteration 386: w = [1.09059019 1.97299646 3.04615544 4.01549039 5.01994347], F(w) = 0.37989574936303827
iteration 387: w = [1.09059021 1.97299658 3.04615531 4.01549007 5.01994323], F(w) = 0.37989617071591264
iteration 388: w = [1.09059023 1.9729967  3.04615518 4.01548974 5.019943  ], F(w) = 0.3798965899080116
iteration 389: w = [1.09059025 1.97299682 3.04615506 4.01548942 5.01994276], F(w) = 0.37989700695592876
iteration 390: w = [1.09059026 1.97299694 3.04615493 4.01548911 5.01994253], F(w) = 0.37989742187606934
iteration 391: w = [1.09059028 1.97299706 3.0461548  4.01548879 5.0199423 ], F(w) = 0.3798978346846844
iteration 392: w = [1.0905903  1.97299718 3.04615468 4.01548848 5.01994207], F(w) = 0.3798982453978553
iteration 393: w = [1.09059032 1.9729973  3.04615455 4.01548816 5.01994184], F(w) = 0.3798986540314838
iteration 394: w = [1.09059034 1.97299742 3.04615443 4.01548785 5.01994161], F(w) = 0.37989906060132406
iteration 395: w = [1.09059036 1.97299754 3.0461543  4.01548754 5.01994138], F(w) = 0.3798994651229944
iteration 396: w = [1.09059037 1.97299765 3.04615418 4.01548723 5.01994116], F(w) = 0.37989986761191064
iteration 397: w = [1.09059039 1.97299777 3.04615406 4.01548693 5.01994093], F(w) = 0.37990026808336724
iteration 398: w = [1.09059041 1.97299789 3.04615394 4.01548662 5.01994071], F(w) = 0.37990066655250965
iteration 399: w = [1.09059043 1.972998   3.04615382 4.01548632 5.01994049], F(w) = 0.37990106303429083
iteration 400: w = [1.09059044 1.97299812 3.0461537  4.01548602 5.01994027], F(w) = 0.37990145754355087
iteration 401: w = [1.09059046 1.97299823 3.04615358 4.01548572 5.01994005], F(w) = 0.37990185009495914
iteration 402: w = [1.09059048 1.97299834 3.04615346 4.01548542 5.01993983], F(w) = 0.37990224070308554
iteration 403: w = [1.0905905  1.97299846 3.04615334 4.01548512 5.01993961], F(w) = 0.37990262938232683
iteration 404: w = [1.09059051 1.97299857 3.04615322 4.01548482 5.01993939], F(w) = 0.3799030161469113
iteration 405: w = [1.09059053 1.97299868 3.0461531  4.01548453 5.01993918], F(w) = 0.37990340101096554
iteration 406: w = [1.09059055 1.97299879 3.04615299 4.01548423 5.01993896], F(w) = 0.3799037839884584
iteration 407: w = [1.09059056 1.9729989  3.04615287 4.01548394 5.01993875], F(w) = 0.3799041650932417
iteration 408: w = [1.09059058 1.97299901 3.04615275 4.01548365 5.01993854], F(w) = 0.37990454433900844
iteration 409: w = [1.0905906  1.97299912 3.04615264 4.01548336 5.01993833], F(w) = 0.37990492173932033
iteration 410: w = [1.09059062 1.97299923 3.04615252 4.01548308 5.01993811], F(w) = 0.379905297307633
iteration 411: w = [1.09059063 1.97299934 3.04615241 4.01548279 5.01993791], F(w) = 0.37990567105724876
iteration 412: w = [1.09059065 1.97299945 3.0461523  4.0154825  5.0199377 ], F(w) = 0.37990604300135056
iteration 413: w = [1.09059067 1.97299956 3.04615218 4.01548222 5.01993749], F(w) = 0.37990641315298246
iteration 414: w = [1.09059068 1.97299967 3.04615207 4.01548194 5.01993728], F(w) = 0.3799067815250669
iteration 415: w = [1.0905907  1.97299977 3.04615196 4.01548166 5.01993708], F(w) = 0.37990714813042137
iteration 416: w = [1.09059071 1.97299988 3.04615185 4.01548138 5.01993687], F(w) = 0.3799075129817089
iteration 417: w = [1.09059073 1.97299998 3.04615174 4.0154811  5.01993667], F(w) = 0.3799078760915171
iteration 418: w = [1.09059075 1.97300009 3.04615163 4.01548082 5.01993647], F(w) = 0.3799082374722574
iteration 419: w = [1.09059076 1.97300019 3.04615152 4.01548055 5.01993627], F(w) = 0.3799085971362611
iteration 420: w = [1.09059078 1.9730003  3.04615141 4.01548027 5.01993606], F(w) = 0.3799089550957393
iteration 421: w = [1.0905908  1.9730004  3.0461513  4.01548    5.01993586], F(w) = 0.37990931136278705
iteration 422: w = [1.09059081 1.9730005  3.04615119 4.01547973 5.01993567], F(w) = 0.3799096659493592
iteration 423: w = [1.09059083 1.97300061 3.04615108 4.01547946 5.01993547], F(w) = 0.37991001886733416
iteration 424: w = [1.09059084 1.97300071 3.04615097 4.01547919 5.01993527], F(w) = 0.3799103701284522
iteration 425: w = [1.09059086 1.97300081 3.04615087 4.01547892 5.01993508], F(w) = 0.379910719744352
iteration 426: w = [1.09059087 1.97300091 3.04615076 4.01547866 5.01993488], F(w) = 0.3799110677265866
iteration 427: w = [1.09059089 1.97300101 3.04615066 4.01547839 5.01993469], F(w) = 0.3799114140865704
iteration 428: w = [1.09059091 1.97300111 3.04615055 4.01547813 5.01993449], F(w) = 0.37991175883561246
iteration 429: w = [1.09059092 1.97300121 3.04615045 4.01547786 5.0199343 ], F(w) = 0.37991210198492664
iteration 430: w = [1.09059094 1.97300131 3.04615034 4.0154776  5.01993411], F(w) = 0.3799124435456174
iteration 431: w = [1.09059095 1.97300141 3.04615024 4.01547734 5.01993392], F(w) = 0.37991278352870705
iteration 432: w = [1.09059097 1.97300151 3.04615013 4.01547708 5.01993373], F(w) = 0.37991312194509863
iteration 433: w = [1.09059098 1.97300161 3.04615003 4.01547682 5.01993354], F(w) = 0.3799134588056022
iteration 434: w = [1.090591   1.9730017  3.04614993 4.01547657 5.01993335], F(w) = 0.3799137941209182
iteration 435: w = [1.09059101 1.9730018  3.04614983 4.01547631 5.01993316], F(w) = 0.3799141279016443
iteration 436: w = [1.09059103 1.9730019  3.04614973 4.01547606 5.01993298], F(w) = 0.37991446015829616
iteration 437: w = [1.09059104 1.97300199 3.04614962 4.0154758  5.01993279], F(w) = 0.3799147909012896
iteration 438: w = [1.09059106 1.97300209 3.04614952 4.01547555 5.01993261], F(w) = 0.3799151201409607
iteration 439: w = [1.09059107 1.97300219 3.04614942 4.0154753  5.01993243], F(w) = 0.3799154478875185
iteration 440: w = [1.09059109 1.97300228 3.04614932 4.01547505 5.01993224], F(w) = 0.3799157741511065
iteration 441: w = [1.0905911  1.97300238 3.04614922 4.0154748  5.01993206], F(w) = 0.37991609894176953
iteration 442: w = [1.09059111 1.97300247 3.04614913 4.01547455 5.01993188], F(w) = 0.37991642226944516
iteration 443: w = [1.09059113 1.97300256 3.04614903 4.01547431 5.0199317 ], F(w) = 0.3799167441440141
iteration 444: w = [1.09059114 1.97300266 3.04614893 4.01547406 5.01993152], F(w) = 0.37991706457523444
iteration 445: w = [1.09059116 1.97300275 3.04614883 4.01547382 5.01993134], F(w) = 0.3799173835728107
iteration 446: w = [1.09059117 1.97300284 3.04614874 4.01547357 5.01993116], F(w) = 0.3799177011463313
iteration 447: w = [1.09059119 1.97300293 3.04614864 4.01547333 5.01993098], F(w) = 0.3799180173053167
iteration 448: w = [1.0905912  1.97300302 3.04614854 4.01547309 5.01993081], F(w) = 0.37991833205919573
iteration 449: w = [1.09059122 1.97300312 3.04614845 4.01547285 5.01993063], F(w) = 0.3799186454173049
iteration 450: w = [1.09059123 1.97300321 3.04614835 4.01547261 5.01993046], F(w) = 0.3799189573889186
iteration 451: w = [1.09059124 1.9730033  3.04614826 4.01547237 5.01993028], F(w) = 0.3799192679832378
iteration 452: w = [1.09059126 1.97300339 3.04614816 4.01547214 5.01993011], F(w) = 0.3799195772093341
iteration 453: w = [1.09059127 1.97300348 3.04614807 4.0154719  5.01992994], F(w) = 0.3799198850762533
iteration 454: w = [1.09059128 1.97300356 3.04614798 4.01547167 5.01992977], F(w) = 0.37992019159292134
iteration 455: w = [1.0905913  1.97300365 3.04614788 4.01547143 5.0199296 ], F(w) = 0.3799204967681968
iteration 456: w = [1.09059131 1.97300374 3.04614779 4.0154712  5.01992942], F(w) = 0.3799208006108776
iteration 457: w = [1.09059133 1.97300383 3.0461477  4.01547097 5.01992926], F(w) = 0.37992110312967553
iteration 458: w = [1.09059134 1.97300392 3.0461476  4.01547074 5.01992909], F(w) = 0.37992140433321797
iteration 459: w = [1.09059135 1.973004   3.04614751 4.01547051 5.01992892], F(w) = 0.37992170423006766
iteration 460: w = [1.09059137 1.97300409 3.04614742 4.01547028 5.01992875], F(w) = 0.379922002828701
iteration 461: w = [1.09059138 1.97300418 3.04614733 4.01547005 5.01992858], F(w) = 0.37992230013754824
iteration 462: w = [1.09059139 1.97300426 3.04614724 4.01546982 5.01992842], F(w) = 0.37992259616493695
iteration 463: w = [1.09059141 1.97300435 3.04614715 4.0154696  5.01992825], F(w) = 0.37992289091912557
iteration 464: w = [1.09059142 1.97300443 3.04614706 4.01546937 5.01992809], F(w) = 0.37992318440831124
iteration 465: w = [1.09059143 1.97300452 3.04614697 4.01546915 5.01992792], F(w) = 0.37992347664064857
iteration 466: w = [1.09059145 1.9730046  3.04614688 4.01546893 5.01992776], F(w) = 0.3799237676241541
iteration 467: w = [1.09059146 1.97300469 3.04614679 4.01546871 5.0199276 ], F(w) = 0.3799240573668521
iteration 468: w = [1.09059147 1.97300477 3.04614671 4.01546848 5.01992744], F(w) = 0.379924345876654
iteration 469: w = [1.09059149 1.97300486 3.04614662 4.01546826 5.01992728], F(w) = 0.3799246331614035
iteration 470: w = [1.0905915  1.97300494 3.04614653 4.01546805 5.01992712], F(w) = 0.3799249192288874
iteration 471: w = [1.09059151 1.97300502 3.04614644 4.01546783 5.01992696], F(w) = 0.3799252040868386
iteration 472: w = [1.09059152 1.9730051  3.04614636 4.01546761 5.0199268 ], F(w) = 0.37992548774290275
iteration 473: w = [1.09059154 1.97300519 3.04614627 4.01546739 5.01992664], F(w) = 0.37992577020467494
iteration 474: w = [1.09059155 1.97300527 3.04614619 4.01546718 5.01992648], F(w) = 0.3799260514796825
iteration 475: w = [1.09059156 1.97300535 3.0461461  4.01546696 5.01992632], F(w) = 0.3799263315753925
iteration 476: w = [1.09059158 1.97300543 3.04614601 4.01546675 5.01992617], F(w) = 0.37992661049919324
iteration 477: w = [1.09059159 1.97300551 3.04614593 4.01546654 5.01992601], F(w) = 0.3799268882584226
iteration 478: w = [1.0905916  1.97300559 3.04614585 4.01546632 5.01992586], F(w) = 0.37992716486037253
iteration 479: w = [1.09059161 1.97300567 3.04614576 4.01546611 5.0199257 ], F(w) = 0.37992744031225295
iteration 480: w = [1.09059163 1.97300575 3.04614568 4.0154659  5.01992555], F(w) = 0.37992771462122765
iteration 481: w = [1.09059164 1.97300583 3.04614559 4.01546569 5.0199254 ], F(w) = 0.37992798779439485
iteration 482: w = [1.09059165 1.97300591 3.04614551 4.01546549 5.01992524], F(w) = 0.3799282598387926
iteration 483: w = [1.09059166 1.97300599 3.04614543 4.01546528 5.01992509], F(w) = 0.37992853076141064
iteration 484: w = [1.09059167 1.97300607 3.04614535 4.01546507 5.01992494], F(w) = 0.37992880056915784
iteration 485: w = [1.09059169 1.97300615 3.04614526 4.01546487 5.01992479], F(w) = 0.3799290692689091
iteration 486: w = [1.0905917  1.97300622 3.04614518 4.01546466 5.01992464], F(w) = 0.3799293368674857
iteration 487: w = [1.09059171 1.9730063  3.0461451  4.01546446 5.01992449], F(w) = 0.37992960337162457
iteration 488: w = [1.09059172 1.97300638 3.04614502 4.01546425 5.01992434], F(w) = 0.37992986878805396
iteration 489: w = [1.09059173 1.97300645 3.04614494 4.01546405 5.01992419], F(w) = 0.37993013312340684
iteration 490: w = [1.09059175 1.97300653 3.04614486 4.01546385 5.01992405], F(w) = 0.37993039638427234
iteration 491: w = [1.09059176 1.97300661 3.04614478 4.01546365 5.0199239 ], F(w) = 0.37993065857717845
iteration 492: w = [1.09059177 1.97300668 3.0461447  4.01546345 5.01992375], F(w) = 0.37993091970861465
iteration 493: w = [1.09059178 1.97300676 3.04614462 4.01546325 5.01992361], F(w) = 0.3799311797850334
iteration 494: w = [1.09059179 1.97300683 3.04614454 4.01546305 5.01992346], F(w) = 0.379931438812806
iteration 495: w = [1.09059181 1.97300691 3.04614446 4.01546285 5.01992332], F(w) = 0.3799316967982513
iteration 496: w = [1.09059182 1.97300698 3.04614438 4.01546266 5.01992317], F(w) = 0.37993195374766947
iteration 497: w = [1.09059183 1.97300706 3.0461443  4.01546246 5.01992303], F(w) = 0.37993220966727864
iteration 498: w = [1.09059184 1.97300713 3.04614423 4.01546227 5.01992289], F(w) = 0.3799324645632477
iteration 499: w = [1.09059185 1.97300721 3.04614415 4.01546207 5.01992275], F(w) = 0.3799327184417104
In [4]:
!python lec02-c03-stochasticGradientDescent.py
iteration 0: w = [0.96444359 1.98994283 3.00645067 4.04896338 4.98754456], F(w) = 0.59439965588068
iteration 1: w = [0.98328616 1.98515179 2.96430196 4.00661396 4.97051553], F(w) = 0.7175819837032674
iteration 2: w = [0.9892486  1.98540868 2.95544768 3.9979082  4.96791458], F(w) = 0.7483195705831317
iteration 3: w = [0.99215414 1.9859499  2.95205225 3.99466281 4.96709854], F(w) = 0.7610105835953699
iteration 4: w = [0.99387212 1.98641913 2.95035728 3.99308843 4.96674539], F(w) = 0.7676457763483975
iteration 5: w = [0.99500689 1.98679593 2.94937378 3.99219999 4.96656108], F(w) = 0.7716265705849915
iteration 6: w = [0.99581237 1.98709786 2.94874457 3.99164663 4.96645224], F(w) = 0.7742403048073606
iteration 7: w = [0.99641378 1.98734291 2.94831347 3.99127713 4.96638206], F(w) = 0.776069290293421
iteration 8: w = [0.99687999 1.98754487 2.94800272 3.99101727 4.96633374], F(w) = 0.7774111677361473
iteration 9: w = [0.99725203 1.98771377 2.9477698  3.99082704 4.96629875], F(w) = 0.7784322926410023
iteration 10: w = [0.99755582 1.98785693 2.94758972 3.99068327 4.96627237], F(w) = 0.7792322184103221
iteration 11: w = [0.99780858 1.98797972 2.94744694 3.99057175 4.96625183], F(w) = 0.7798738271166543
iteration 12: w = [0.99802218 1.98808612 2.94733136 3.99048334 4.96623541], F(w) = 0.7803986151485137
iteration 13: w = [0.99820508 1.98817919 2.94723614 3.99041196 4.96622199], F(w) = 0.7808349763435384
iteration 14: w = [0.99836346 1.98826127 2.94715651 3.99035342 4.96621081], F(w) = 0.7812029402251881
iteration 15: w = [0.99850194 1.98833418 2.94708907 3.99030476 4.96620136], F(w) = 0.7815170080025006
iteration 16: w = [0.99862406 1.98839936 2.9470313  3.99026383 4.96619325], F(w) = 0.7817879165804269
iteration 17: w = [0.99873255 1.98845799 2.94698132 3.99022904 4.96618622], F(w) = 0.7820237727047754
iteration 18: w = [0.99882958 1.98851099 2.94693771 3.99019919 4.96618005], F(w) = 0.782230803437043
iteration 19: w = [0.99891687 1.98855914 2.94689936 3.99017338 4.96617461], F(w) = 0.7824138654582486
iteration 20: w = [0.99899583 1.98860307 2.9468654  3.99015087 4.96616975], F(w) = 0.7825767985210252
iteration 21: w = [0.99906759 1.98864332 2.94683514 3.99013113 4.96616539], F(w) = 0.7827226756807809
iteration 22: w = [0.99913309 1.98868033 2.94680802 3.9901137  4.96616146], F(w) = 0.7828539836462732
iteration 23: w = [0.99919312 1.98871447 2.9467836  3.99009823 4.96615789], F(w) = 0.7829727548793696
iteration 24: w = [0.99924834 1.98874606 2.94676149 3.99008443 4.96615463], F(w) = 0.7830806657782517
iteration 25: w = [0.9992993  1.98877538 2.9467414  3.99007205 4.96615164], F(w) = 0.7831791106313648
iteration 26: w = [0.99934648 1.98880267 2.94672306 3.99006091 4.9661489 ], F(w) = 0.7832692580041003
iteration 27: w = [0.99939029 1.98882813 2.94670627 3.99005084 4.96614636], F(w) = 0.7833520942153592
iteration 28: w = [0.99943107 1.98885193 2.94669084 3.9900417  4.966144  ], F(w) = 0.7834284572071707
iteration 29: w = [0.99946912 1.98887424 2.94667661 3.99003338 4.96614181], F(w) = 0.7834990631830139
iteration 30: w = [0.99950472 1.98889519 2.94666346 3.99002578 4.96613977], F(w) = 0.7835645277447105
iteration 31: w = [0.9995381  1.9889149  2.94665126 3.99001882 4.96613787], F(w) = 0.7836253828024351
iteration 32: w = [0.99956944 1.98893348 2.94663993 3.99001242 4.96613608], F(w) = 0.7836820902071909
iteration 33: w = [0.99959894 1.98895102 2.94662937 3.99000653 4.9661344 ], F(w) = 0.7837350528198176
iteration 34: w = [0.99962676 1.98896761 2.94661951 3.99000109 4.96613281], F(w) = 0.7837846235591048
iteration 35: w = [0.99965303 1.98898332 2.94661028 3.98999605 4.96613132], F(w) = 0.7838311128446077
iteration 36: w = [0.99967788 1.98899822 2.94660163 3.98999138 4.96612991], F(w) = 0.7838747947550708
iteration 37: w = [0.99970141 1.98901237 2.9465935  3.98998703 4.96612858], F(w) = 0.7839159121529184
iteration 38: w = [0.99972375 1.98902583 2.94658585 3.98998298 4.96612731], F(w) = 0.7839546809704756
iteration 39: w = [0.99974496 1.98903865 2.94657864 3.98997921 4.96612611], F(w) = 0.783991293813168
iteration 40: w = [0.99976514 1.98905087 2.94657183 3.98997567 4.96612496], F(w) = 0.7840259230025781
iteration 41: w = [0.99978436 1.98906253 2.9465654  3.98997236 4.96612387], F(w) = 0.7840587231580829
iteration 42: w = [0.99980268 1.98907367 2.9465593  3.98996926 4.96612284], F(w) = 0.7840898333963451
iteration 43: w = [0.99982017 1.98908432 2.94655352 3.98996634 4.96612184], F(w) = 0.7841193792124117
iteration 44: w = [0.99983688 1.98909452 2.94654804 3.9899636  4.9661209 ], F(w) = 0.7841474740952239
iteration 45: w = [0.99985287 1.98910429 2.94654282 3.98996101 4.96611999], F(w) = 0.7841742209196012
iteration 46: w = [0.99986818 1.98911366 2.94653786 3.98995858 4.96611912], F(w) = 0.784199713150188
iteration 47: w = [0.99988284 1.98912266 2.94653313 3.98995627 4.96611828], F(w) = 0.7842240358857864
iteration 48: w = [0.99989691 1.9891313  2.94652862 3.98995409 4.96611748], F(w) = 0.7842472667686391
iteration 49: w = [0.99991042 1.98913961 2.94652431 3.98995203 4.96611672], F(w) = 0.7842694767781414
iteration 50: w = [0.9999234  1.9891476  2.94652019 3.98995007 4.96611598], F(w) = 0.7842907309257899
iteration 51: w = [0.99993588 1.9891553  2.94651625 3.98994821 4.96611527], F(w) = 0.7843110888653835
iteration 52: w = [0.99994788 1.98916272 2.94651248 3.98994645 4.96611458], F(w) = 0.7843306054303205
iteration 53: w = [0.99995945 1.98916987 2.94650887 3.98994477 4.96611392], F(w) = 0.7843493311076808
iteration 54: w = [0.99997059 1.98917677 2.9465054  3.98994317 4.96611328], F(w) = 0.7843673124578789
iteration 55: w = [0.99998133 1.98918343 2.94650207 3.98994165 4.96611267], F(w) = 0.7843845924866253
iteration 56: w = [0.9999917  1.98918986 2.94649888 3.98994019 4.96611208], F(w) = 0.7844012109759604
iteration 57: w = [1.00000171 1.98919608 2.9464958  3.98993881 4.9661115 ], F(w) = 0.7844172047787056
iteration 58: w = [1.00001138 1.9892021  2.94649284 3.98993748 4.96611095], F(w) = 0.7844326080817181
iteration 59: w = [1.00002073 1.98920792 2.94649    3.98993621 4.96611041], F(w) = 0.7844474526412584
iteration 60: w = [1.00002977 1.98921356 2.94648725 3.989935   4.96610989], F(w) = 0.7844617679939123
iteration 61: w = [1.00003852 1.98921901 2.94648461 3.98993384 4.96610939], F(w) = 0.7844755816461602
iteration 62: w = [1.00004699 1.98922431 2.94648206 3.98993273 4.9661089 ], F(w) = 0.7844889192448
iteration 63: w = [1.0000552  1.98922944 2.94647959 3.98993166 4.96610843], F(w) = 0.7845018047306714
iteration 64: w = [1.00006316 1.98923441 2.94647722 3.98993064 4.96610797], F(w) = 0.7845142604773079
iteration 65: w = [1.00007087 1.98923924 2.94647492 3.98992965 4.96610752], F(w) = 0.7845263074165054
iteration 66: w = [1.00007836 1.98924393 2.94647269 3.98992871 4.96610709], F(w) = 0.7845379651520031
iteration 67: w = [1.00008562 1.98924849 2.94647054 3.9899278  4.96610667], F(w) = 0.7845492520625397
iteration 68: w = [1.00009268 1.98925292 2.94646846 3.98992693 4.96610626], F(w) = 0.7845601853955414
iteration 69: w = [1.00009953 1.98925722 2.94646645 3.98992609 4.96610586], F(w) = 0.784570781352515
iteration 70: w = [1.00010619 1.98926141 2.94646449 3.98992528 4.96610547], F(w) = 0.784581055166612
iteration 71: w = [1.00011266 1.98926548 2.9464626  3.98992449 4.9661051 ], F(w) = 0.7845910211736271
iteration 72: w = [1.00011896 1.98926944 2.94646076 3.98992374 4.96610473], F(w) = 0.7846006928767313
iteration 73: w = [1.00012509 1.9892733  2.94645898 3.98992301 4.96610437], F(w) = 0.7846100830057363
iteration 74: w = [1.00013105 1.98927706 2.94645725 3.98992231 4.96610403], F(w) = 0.7846192035715179
iteration 75: w = [1.00013686 1.98928073 2.94645557 3.98992164 4.96610369], F(w) = 0.7846280659156685
iteration 76: w = [1.00014251 1.9892843  2.94645394 3.98992098 4.96610336], F(w) = 0.784636680756338
iteration 77: w = [1.00014803 1.98928778 2.94645235 3.98992035 4.96610303], F(w) = 0.7846450582302469
iteration 78: w = [1.0001534  1.98929117 2.94645081 3.98991974 4.96610272], F(w) = 0.7846532079314801
iteration 79: w = [1.00015864 1.98929448 2.94644931 3.98991914 4.96610241], F(w) = 0.7846611389470514
iteration 80: w = [1.00016374 1.98929771 2.94644786 3.98991857 4.96610211], F(w) = 0.7846688598898351
iteration 81: w = [1.00016873 1.98930087 2.94644644 3.98991802 4.96610182], F(w) = 0.7846763789289819
iteration 82: w = [1.00017359 1.98930395 2.94644505 3.98991748 4.96610153], F(w) = 0.7846837038179375
iteration 83: w = [1.00017834 1.98930696 2.94644371 3.98991696 4.96610126], F(w) = 0.7846908419205175
iteration 84: w = [1.00018298 1.9893099  2.9464424  3.98991645 4.96610098], F(w) = 0.7846978002349126
iteration 85: w = [1.00018751 1.98931277 2.94644112 3.98991596 4.96610072], F(w) = 0.7847045854160164
iteration 86: w = [1.00019193 1.98931558 2.94643987 3.98991549 4.96610045], F(w) = 0.7847112037961657
iteration 87: w = [1.00019625 1.98931832 2.94643865 3.98991503 4.9661002 ], F(w) = 0.7847176614042584
iteration 88: w = [1.00020048 1.98932101 2.94643747 3.98991458 4.96609995], F(w) = 0.784723963983769
iteration 89: w = [1.00020462 1.98932364 2.94643631 3.98991414 4.9660997 ], F(w) = 0.7847301170092711
iteration 90: w = [1.00020866 1.98932621 2.94643518 3.98991372 4.96609946], F(w) = 0.7847361257019777
iteration 91: w = [1.00021261 1.98932872 2.94643408 3.98991331 4.96609923], F(w) = 0.7847419950441793
iteration 92: w = [1.00021648 1.98933118 2.946433   3.98991291 4.966099  ], F(w) = 0.784747729792665
iteration 93: w = [1.00022027 1.9893336  2.94643195 3.98991252 4.96609878], F(w) = 0.7847533344912703
iteration 94: w = [1.00022398 1.98933596 2.94643092 3.98991214 4.96609856], F(w) = 0.7847588134826459
iteration 95: w = [1.00022761 1.98933827 2.94642992 3.98991178 4.96609834], F(w) = 0.7847641709192538
iteration 96: w = [1.00023116 1.98934054 2.94642893 3.98991142 4.96609813], F(w) = 0.78476941077357
iteration 97: w = [1.00023465 1.98934276 2.94642797 3.98991107 4.96609792], F(w) = 0.7847745368476855
iteration 98: w = [1.00023806 1.98934493 2.94642703 3.98991073 4.96609772], F(w) = 0.7847795527823793
iteration 99: w = [1.0002414  1.98934707 2.94642611 3.9899104  4.96609752], F(w) = 0.7847844620654985
iteration 100: w = [1.00024468 1.98934916 2.94642521 3.98991007 4.96609732], F(w) = 0.7847892680398596
iteration 101: w = [1.0002479  1.98935122 2.94642433 3.98990976 4.96609713], F(w) = 0.7847939739107556
iteration 102: w = [1.00025105 1.98935323 2.94642347 3.98990945 4.96609694], F(w) = 0.7847985827528058
iteration 103: w = [1.00025414 1.9893552  2.94642263 3.98990915 4.96609676], F(w) = 0.7848030975166845
iteration 104: w = [1.00025717 1.98935714 2.9464218  3.98990886 4.96609657], F(w) = 0.7848075210351195
iteration 105: w = [1.00026015 1.98935905 2.94642099 3.98990858 4.9660964 ], F(w) = 0.7848118560288021
iteration 106: w = [1.00026307 1.98936091 2.9464202  3.9899083  4.96609622], F(w) = 0.7848161051118432
iteration 107: w = [1.00026593 1.98936275 2.94641942 3.98990803 4.96609605], F(w) = 0.7848202707968787
iteration 108: w = [1.00026875 1.98936455 2.94641866 3.98990776 4.96609588], F(w) = 0.7848243554999953
iteration 109: w = [1.00027151 1.98936632 2.94641791 3.9899075  4.96609571], F(w) = 0.7848283615452541
iteration 110: w = [1.00027422 1.98936805 2.94641718 3.98990725 4.96609555], F(w) = 0.7848322911689938
iteration 111: w = [1.00027688 1.98936976 2.94641646 3.989907   4.96609539], F(w) = 0.784836146524014
iteration 112: w = [1.0002795  1.98937144 2.94641575 3.98990676 4.96609523], F(w) = 0.7848399296833257
iteration 113: w = [1.00028207 1.98937309 2.94641506 3.98990653 4.96609508], F(w) = 0.784843642643839
iteration 114: w = [1.0002846  1.98937471 2.94641438 3.9899063  4.96609493], F(w) = 0.7848472873298454
iteration 115: w = [1.00028708 1.9893763  2.94641371 3.98990607 4.96609478], F(w) = 0.7848508655962539
iteration 116: w = [1.00028952 1.98937786 2.94641306 3.98990585 4.96609463], F(w) = 0.7848543792315882
iteration 117: w = [1.00029192 1.9893794  2.94641242 3.98990563 4.96609448], F(w) = 0.7848578299610571
iteration 118: w = [1.00029428 1.98938092 2.94641179 3.98990542 4.96609434], F(w) = 0.7848612194492669
iteration 119: w = [1.0002966  1.98938241 2.94641117 3.98990521 4.9660942 ], F(w) = 0.7848645493029182
iteration 120: w = [1.00029888 1.98938387 2.94641056 3.98990501 4.96609406], F(w) = 0.7848678210731371
iteration 121: w = [1.00030112 1.98938532 2.94640996 3.98990481 4.96609392], F(w) = 0.7848710362579374
iteration 122: w = [1.00030333 1.98938673 2.94640937 3.98990462 4.96609379], F(w) = 0.7848741963045434
iteration 123: w = [1.0003055  1.98938813 2.9464088  3.98990443 4.96609366], F(w) = 0.7848773026113857
iteration 124: w = [1.00030764 1.9893895  2.94640823 3.98990424 4.96609353], F(w) = 0.7848803565302099
iteration 125: w = [1.00030974 1.98939086 2.94640767 3.98990406 4.9660934 ], F(w) = 0.7848833593680171
iteration 126: w = [1.00031181 1.98939219 2.94640712 3.98990388 4.96609328], F(w) = 0.7848863123888379
iteration 127: w = [1.00031385 1.9893935  2.94640658 3.9899037  4.96609315], F(w) = 0.7848892168154445
iteration 128: w = [1.00031585 1.98939479 2.94640605 3.98990353 4.96609303], F(w) = 0.7848920738311517
iteration 129: w = [1.00031783 1.98939606 2.94640553 3.98990336 4.96609291], F(w) = 0.7848948845812886
iteration 130: w = [1.00031977 1.98939731 2.94640502 3.9899032  4.96609279], F(w) = 0.7848976501747522
iteration 131: w = [1.00032169 1.98939855 2.94640451 3.98990303 4.96609267], F(w) = 0.7849003716853561
iteration 132: w = [1.00032358 1.98939976 2.94640402 3.98990287 4.96609256], F(w) = 0.7849030501533288
iteration 133: w = [1.00032544 1.98940096 2.94640353 3.98990272 4.96609244], F(w) = 0.7849056865865294
iteration 134: w = [1.00032727 1.98940214 2.94640305 3.98990257 4.96609233], F(w) = 0.7849082819616994
iteration 135: w = [1.00032907 1.9894033  2.94640257 3.98990241 4.96609222], F(w) = 0.7849108372256932
iteration 136: w = [1.00033085 1.98940445 2.94640211 3.98990227 4.96609211], F(w) = 0.7849133532965971
iteration 137: w = [1.0003326  1.98940558 2.94640165 3.98990212 4.96609201], F(w) = 0.7849158310646829
iteration 138: w = [1.00033433 1.98940669 2.9464012  3.98990198 4.9660919 ], F(w) = 0.7849182713936721
iteration 139: w = [1.00033603 1.98940779 2.94640075 3.98990184 4.9660918 ], F(w) = 0.7849206751215679
iteration 140: w = [1.00033771 1.98940888 2.94640031 3.9899017  4.96609169], F(w) = 0.7849230430616649
iteration 141: w = [1.00033936 1.98940994 2.94639988 3.98990157 4.96609159], F(w) = 0.7849253760033673
iteration 142: w = [1.000341   1.989411   2.94639946 3.98990143 4.96609149], F(w) = 0.7849276747131766
iteration 143: w = [1.0003426  1.98941203 2.94639904 3.9899013  4.96609139], F(w) = 0.7849299399354298
iteration 144: w = [1.00034419 1.98941306 2.94639862 3.98990118 4.96609129], F(w) = 0.7849321723931031
iteration 145: w = [1.00034576 1.98941407 2.94639822 3.98990105 4.9660912 ], F(w) = 0.7849343727886122
iteration 146: w = [1.0003473  1.98941507 2.94639782 3.98990093 4.9660911 ], F(w) = 0.784936541804433
iteration 147: w = [1.00034882 1.98941605 2.94639742 3.9899008  4.96609101], F(w) = 0.784938680103969
iteration 148: w = [1.00035032 1.98941702 2.94639703 3.98990069 4.96609092], F(w) = 0.784940788332037
iteration 149: w = [1.00035181 1.98941798 2.94639665 3.98990057 4.96609083], F(w) = 0.7849428671156744
iteration 150: w = [1.00035327 1.98941893 2.94639627 3.98990045 4.96609074], F(w) = 0.7849449170646294
iteration 151: w = [1.00035471 1.98941986 2.94639589 3.98990034 4.96609065], F(w) = 0.784946938771943
iteration 152: w = [1.00035614 1.98942078 2.94639553 3.98990023 4.96609056], F(w) = 0.7849489328146139
iteration 153: w = [1.00035754 1.98942169 2.94639516 3.98990012 4.96609047], F(w) = 0.784950899754079
iteration 154: w = [1.00035893 1.98942259 2.9463948  3.98990001 4.96609039], F(w) = 0.7849528401366941
iteration 155: w = [1.0003603  1.98942347 2.94639445 3.9898999  4.9660903 ], F(w) = 0.784954754494287
iteration 156: w = [1.00036166 1.98942435 2.9463941  3.9898998  4.96609022], F(w) = 0.7849566433446741
iteration 157: w = [1.00036299 1.98942521 2.94639376 3.98989969 4.96609013], F(w) = 0.7849585071919933
iteration 158: w = [1.00036431 1.98942607 2.94639342 3.98989959 4.96609005], F(w) = 0.7849603465273215
iteration 159: w = [1.00036561 1.98942691 2.94639308 3.98989949 4.96608997], F(w) = 0.7849621618289534
iteration 160: w = [1.0003669  1.98942774 2.94639275 3.98989939 4.96608989], F(w) = 0.7849639535627918
iteration 161: w = [1.00036817 1.98942857 2.94639243 3.9898993  4.96608981], F(w) = 0.7849657221828886
iteration 162: w = [1.00036942 1.98942938 2.94639211 3.9898992  4.96608974], F(w) = 0.7849674681317499
iteration 163: w = [1.00037066 1.98943018 2.94639179 3.98989911 4.96608966], F(w) = 0.7849691918406527
iteration 164: w = [1.00037189 1.98943097 2.94639147 3.98989902 4.96608958], F(w) = 0.7849708937300942
iteration 165: w = [1.0003731  1.98943176 2.94639116 3.98989892 4.96608951], F(w) = 0.7849725742099687
iteration 166: w = [1.00037429 1.98943253 2.94639086 3.98989883 4.96608943], F(w) = 0.7849742336801206
iteration 167: w = [1.00037547 1.9894333  2.94639056 3.98989875 4.96608936], F(w) = 0.7849758725304602
iteration 168: w = [1.00037664 1.98943405 2.94639026 3.98989866 4.96608929], F(w) = 0.7849774911413436
iteration 169: w = [1.00037779 1.9894348  2.94638996 3.98989857 4.96608922], F(w) = 0.7849790898838594
iteration 170: w = [1.00037893 1.98943554 2.94638967 3.98989849 4.96608914], F(w) = 0.7849806691201262
iteration 171: w = [1.00038006 1.98943627 2.94638939 3.98989841 4.96608907], F(w) = 0.7849822292035266
iteration 172: w = [1.00038117 1.98943699 2.9463891  3.98989832 4.966089  ], F(w) = 0.7849837704789704
iteration 173: w = [1.00038228 1.98943771 2.94638882 3.98989824 4.96608894], F(w) = 0.7849852932832011
iteration 174: w = [1.00038336 1.98943841 2.94638855 3.98989816 4.96608887], F(w) = 0.7849867979448999
iteration 175: w = [1.00038444 1.98943911 2.94638827 3.98989808 4.9660888 ], F(w) = 0.7849882847851763
iteration 176: w = [1.0003855  1.9894398  2.946388   3.98989801 4.96608873], F(w) = 0.78498975411746
iteration 177: w = [1.00038656 1.98944048 2.94638773 3.98989793 4.96608867], F(w) = 0.7849912062480275
iteration 178: w = [1.0003876  1.98944116 2.94638747 3.98989785 4.9660886 ], F(w) = 0.7849926414760073
iteration 179: w = [1.00038862 1.98944183 2.94638721 3.98989778 4.96608854], F(w) = 0.7849940600936216
iteration 180: w = [1.00038964 1.98944249 2.94638695 3.98989771 4.96608848], F(w) = 0.78499546238653
iteration 181: w = [1.00039065 1.98944314 2.9463867  3.98989763 4.96608841], F(w) = 0.7849968486337782
iteration 182: w = [1.00039164 1.98944379 2.94638644 3.98989756 4.96608835], F(w) = 0.7849982191081799
iteration 183: w = [1.00039263 1.98944443 2.9463862  3.98989749 4.96608829], F(w) = 0.7849995740763192
iteration 184: w = [1.0003936  1.98944506 2.94638595 3.98989742 4.96608823], F(w) = 0.7850009137989612
iteration 185: w = [1.00039456 1.98944568 2.94638571 3.98989735 4.96608817], F(w) = 0.7850022385309989
iteration 186: w = [1.00039552 1.9894463  2.94638546 3.98989729 4.96608811], F(w) = 0.7850035485216671
iteration 187: w = [1.00039646 1.98944692 2.94638523 3.98989722 4.96608805], F(w) = 0.785004844014745
iteration 188: w = [1.00039739 1.98944752 2.94638499 3.98989715 4.96608799], F(w) = 0.7850061252486937
iteration 189: w = [1.00039831 1.98944812 2.94638476 3.98989709 4.96608793], F(w) = 0.7850073924568018
iteration 190: w = [1.00039923 1.98944871 2.94638453 3.98989702 4.96608788], F(w) = 0.7850086458672726
iteration 191: w = [1.00040013 1.9894493  2.9463843  3.98989696 4.96608782], F(w) = 0.7850098857034046
iteration 192: w = [1.00040103 1.98944988 2.94638408 3.9898969  4.96608776], F(w) = 0.785011112183735
iteration 193: w = [1.00040191 1.98945046 2.94638385 3.98989684 4.96608771], F(w) = 0.7850123255221304
iteration 194: w = [1.00040279 1.98945103 2.94638363 3.98989677 4.96608765], F(w) = 0.7850135259279419
iteration 195: w = [1.00040365 1.98945159 2.94638341 3.98989671 4.9660876 ], F(w) = 0.7850147136060941
iteration 196: w = [1.00040451 1.98945215 2.9463832  3.98989665 4.96608754], F(w) = 0.7850158887572108
iteration 197: w = [1.00040536 1.9894527  2.94638299 3.9898966  4.96608749], F(w) = 0.7850170515777637
iteration 198: w = [1.0004062  1.98945325 2.94638277 3.98989654 4.96608744], F(w) = 0.7850182022601645
iteration 199: w = [1.00040704 1.98945379 2.94638256 3.98989648 4.96608738], F(w) = 0.7850193409927638
iteration 200: w = [1.00040786 1.98945433 2.94638236 3.98989642 4.96608733], F(w) = 0.7850204679600977
iteration 201: w = [1.00040868 1.98945486 2.94638215 3.98989637 4.96608728], F(w) = 0.7850215833429622
iteration 202: w = [1.00040949 1.98945539 2.94638195 3.98989631 4.96608723], F(w) = 0.7850226873184569
iteration 203: w = [1.00041029 1.98945591 2.94638175 3.98989626 4.96608718], F(w) = 0.7850237800600796
iteration 204: w = [1.00041108 1.98945642 2.94638155 3.9898962  4.96608713], F(w) = 0.7850248617378143
iteration 205: w = [1.00041186 1.98945693 2.94638136 3.98989615 4.96608708], F(w) = 0.7850259325183263
iteration 206: w = [1.00041264 1.98945744 2.94638116 3.9898961  4.96608703], F(w) = 0.7850269925648745
iteration 207: w = [1.00041341 1.98945794 2.94638097 3.98989605 4.96608698], F(w) = 0.785028042037531
iteration 208: w = [1.00041417 1.98945844 2.94638078 3.98989599 4.96608693], F(w) = 0.78502908109315
iteration 209: w = [1.00041493 1.98945893 2.94638059 3.98989594 4.96608689], F(w) = 0.7850301098855849
iteration 210: w = [1.00041568 1.98945942 2.9463804  3.98989589 4.96608684], F(w) = 0.7850311285656207
iteration 211: w = [1.00041642 1.9894599  2.94638022 3.98989584 4.96608679], F(w) = 0.7850321372811456
iteration 212: w = [1.00041715 1.98946038 2.94638004 3.98989579 4.96608675], F(w) = 0.7850331361771742
iteration 213: w = [1.00041788 1.98946085 2.94637985 3.98989575 4.9660867 ], F(w) = 0.7850341253959265
iteration 214: w = [1.0004186  1.98946132 2.94637967 3.9898957  4.96608665], F(w) = 0.7850351050768893
iteration 215: w = [1.00041931 1.98946178 2.9463795  3.98989565 4.96608661], F(w) = 0.7850360753569089
iteration 216: w = [1.00042002 1.98946224 2.94637932 3.9898956  4.96608656], F(w) = 0.7850370363701955
iteration 217: w = [1.00042072 1.9894627  2.94637915 3.98989556 4.96608652], F(w) = 0.7850379882484784
iteration 218: w = [1.00042142 1.98946315 2.94637897 3.98989551 4.96608648], F(w) = 0.7850389311209134
iteration 219: w = [1.0004221  1.9894636  2.9463788  3.98989547 4.96608643], F(w) = 0.7850398651143579
iteration 220: w = [1.00042279 1.98946405 2.94637863 3.98989542 4.96608639], F(w) = 0.7850407903532501
iteration 221: w = [1.00042346 1.98946449 2.94637847 3.98989538 4.96608635], F(w) = 0.7850417069596651
iteration 222: w = [1.00042413 1.98946492 2.9463783  3.98989533 4.9660863 ], F(w) = 0.7850426150535017
iteration 223: w = [1.0004248  1.98946536 2.94637813 3.98989529 4.96608626], F(w) = 0.7850435147524081
iteration 224: w = [1.00042545 1.98946578 2.94637797 3.98989525 4.96608622], F(w) = 0.785044406171921
iteration 225: w = [1.0004261  1.98946621 2.94637781 3.9898952  4.96608618], F(w) = 0.7850452894254714
iteration 226: w = [1.00042675 1.98946663 2.94637765 3.98989516 4.96608614], F(w) = 0.7850461646243395
iteration 227: w = [1.00042739 1.98946705 2.94637749 3.98989512 4.9660861 ], F(w) = 0.7850470318778934
iteration 228: w = [1.00042803 1.98946746 2.94637733 3.98989508 4.96608606], F(w) = 0.7850478912934947
iteration 229: w = [1.00042866 1.98946787 2.94637718 3.98989504 4.96608602], F(w) = 0.7850487429765964
iteration 230: w = [1.00042928 1.98946828 2.94637702 3.989895   4.96608598], F(w) = 0.7850495870308118
iteration 231: w = [1.0004299  1.98946868 2.94637687 3.98989496 4.96608594], F(w) = 0.7850504235578771
iteration 232: w = [1.00043051 1.98946908 2.94637672 3.98989492 4.9660859 ], F(w) = 0.7850512526576918
iteration 233: w = [1.00043112 1.98946948 2.94637657 3.98989488 4.96608586], F(w) = 0.7850520744284167
iteration 234: w = [1.00043172 1.98946987 2.94637642 3.98989484 4.96608582], F(w) = 0.785052888966565
iteration 235: w = [1.00043232 1.98947026 2.94637627 3.9898948  4.96608578], F(w) = 0.7850536963669047
iteration 236: w = [1.00043291 1.98947065 2.94637613 3.98989477 4.96608574], F(w) = 0.7850544967225673
iteration 237: w = [1.0004335  1.98947103 2.94637598 3.98989473 4.96608571], F(w) = 0.7850552901250539
iteration 238: w = [1.00043408 1.98947141 2.94637584 3.98989469 4.96608567], F(w) = 0.7850560766643504
iteration 239: w = [1.00043466 1.98947179 2.94637569 3.98989466 4.96608563], F(w) = 0.7850568564288388
iteration 240: w = [1.00043524 1.98947217 2.94637555 3.98989462 4.9660856 ], F(w) = 0.7850576295054522
iteration 241: w = [1.0004358  1.98947254 2.94637541 3.98989458 4.96608556], F(w) = 0.7850583959796097
iteration 242: w = [1.00043637 1.9894729  2.94637527 3.98989455 4.96608552], F(w) = 0.7850591559352557
iteration 243: w = [1.00043693 1.98947327 2.94637514 3.98989451 4.96608549], F(w) = 0.785059909454972
iteration 244: w = [1.00043748 1.98947363 2.946375   3.98989448 4.96608545], F(w) = 0.7850606566199367
iteration 245: w = [1.00043803 1.98947399 2.94637486 3.98989444 4.96608542], F(w) = 0.7850613975099512
iteration 246: w = [1.00043858 1.98947435 2.94637473 3.98989441 4.96608538], F(w) = 0.7850621322035353
iteration 247: w = [1.00043912 1.9894747  2.9463746  3.98989437 4.96608535], F(w) = 0.7850628607778483
iteration 248: w = [1.00043966 1.98947505 2.94637446 3.98989434 4.96608531], F(w) = 0.7850635833088373
iteration 249: w = [1.00044019 1.9894754  2.94637433 3.98989431 4.96608528], F(w) = 0.785064299871175
iteration 250: w = [1.00044072 1.98947574 2.9463742  3.98989428 4.96608525], F(w) = 0.7850650105382907
iteration 251: w = [1.00044124 1.98947609 2.94637407 3.98989424 4.96608521], F(w) = 0.7850657153824306
iteration 252: w = [1.00044176 1.98947643 2.94637395 3.98989421 4.96608518], F(w) = 0.785066414474648
iteration 253: w = [1.00044228 1.98947676 2.94637382 3.98989418 4.96608515], F(w) = 0.7850671078849146
iteration 254: w = [1.00044279 1.9894771  2.94637369 3.98989415 4.96608511], F(w) = 0.7850677956820226
iteration 255: w = [1.0004433  1.98947743 2.94637357 3.98989412 4.96608508], F(w) = 0.785068477933659
iteration 256: w = [1.0004438  1.98947776 2.94637345 3.98989408 4.96608505], F(w) = 0.7850691547064566
iteration 257: w = [1.0004443  1.98947809 2.94637332 3.98989405 4.96608502], F(w) = 0.7850698260659166
iteration 258: w = [1.0004448  1.98947841 2.9463732  3.98989402 4.96608499], F(w) = 0.7850704920765758
iteration 259: w = [1.00044529 1.98947873 2.94637308 3.98989399 4.96608495], F(w) = 0.7850711528019604
iteration 260: w = [1.00044578 1.98947905 2.94637296 3.98989396 4.96608492], F(w) = 0.7850718083045456
iteration 261: w = [1.00044626 1.98947937 2.94637284 3.98989393 4.96608489], F(w) = 0.7850724586458089
iteration 262: w = [1.00044674 1.98947968 2.94637273 3.9898939  4.96608486], F(w) = 0.7850731038863525
iteration 263: w = [1.00044722 1.98947999 2.94637261 3.98989388 4.96608483], F(w) = 0.7850737440857674
iteration 264: w = [1.0004477  1.9894803  2.94637249 3.98989385 4.9660848 ], F(w) = 0.7850743793027657
iteration 265: w = [1.00044817 1.98948061 2.94637238 3.98989382 4.96608477], F(w) = 0.7850750095951173
iteration 266: w = [1.00044863 1.98948092 2.94637226 3.98989379 4.96608474], F(w) = 0.7850756350197281
iteration 267: w = [1.0004491  1.98948122 2.94637215 3.98989376 4.96608471], F(w) = 0.7850762556326086
iteration 268: w = [1.00044956 1.98948152 2.94637204 3.98989373 4.96608468], F(w) = 0.7850768714889242
iteration 269: w = [1.00045001 1.98948182 2.94637193 3.98989371 4.96608465], F(w) = 0.7850774826430266
iteration 270: w = [1.00045047 1.98948212 2.94637182 3.98989368 4.96608462], F(w) = 0.7850780891484053
iteration 271: w = [1.00045092 1.98948241 2.94637171 3.98989365 4.96608459], F(w) = 0.7850786910577877
iteration 272: w = [1.00045136 1.9894827  2.9463716  3.98989363 4.96608456], F(w) = 0.7850792884230349
iteration 273: w = [1.00045181 1.98948299 2.94637149 3.9898936  4.96608454], F(w) = 0.7850798812953493
iteration 274: w = [1.00045225 1.98948328 2.94637138 3.98989357 4.96608451], F(w) = 0.7850804697250355
iteration 275: w = [1.00045268 1.98948357 2.94637127 3.98989355 4.96608448], F(w) = 0.7850810537617302
iteration 276: w = [1.00045312 1.98948385 2.94637117 3.98989352 4.96608445], F(w) = 0.7850816334543608
iteration 277: w = [1.00045355 1.98948413 2.94637106 3.98989349 4.96608442], F(w) = 0.7850822088510614
iteration 278: w = [1.00045397 1.98948441 2.94637096 3.98989347 4.9660844 ], F(w) = 0.7850827799992437
iteration 279: w = [1.0004544  1.98948469 2.94637086 3.98989344 4.96608437], F(w) = 0.7850833469457545
iteration 280: w = [1.00045482 1.98948496 2.94637075 3.98989342 4.96608434], F(w) = 0.7850839097365957
iteration 281: w = [1.00045524 1.98948524 2.94637065 3.98989339 4.96608431], F(w) = 0.7850844684172228
iteration 282: w = [1.00045565 1.98948551 2.94637055 3.98989337 4.96608429], F(w) = 0.7850850230323565
iteration 283: w = [1.00045607 1.98948578 2.94637045 3.98989335 4.96608426], F(w) = 0.7850855736261292
iteration 284: w = [1.00045648 1.98948605 2.94637035 3.98989332 4.96608423], F(w) = 0.7850861202419914
iteration 285: w = [1.00045688 1.98948631 2.94637025 3.9898933  4.96608421], F(w) = 0.7850866629227913
iteration 286: w = [1.00045729 1.98948658 2.94637015 3.98989327 4.96608418], F(w) = 0.7850872017107803
iteration 287: w = [1.00045769 1.98948684 2.94637006 3.98989325 4.96608416], F(w) = 0.7850877366475806
iteration 288: w = [1.00045809 1.9894871  2.94636996 3.98989323 4.96608413], F(w) = 0.7850882677742383
iteration 289: w = [1.00045848 1.98948736 2.94636986 3.9898932  4.96608411], F(w) = 0.7850887951312063
iteration 290: w = [1.00045888 1.98948762 2.94636977 3.98989318 4.96608408], F(w) = 0.7850893187583708
iteration 291: w = [1.00045927 1.98948787 2.94636967 3.98989316 4.96608405], F(w) = 0.7850898386950972
iteration 292: w = [1.00045965 1.98948813 2.94636958 3.98989313 4.96608403], F(w) = 0.785090354980156
iteration 293: w = [1.00046004 1.98948838 2.94636949 3.98989311 4.966084  ], F(w) = 0.7850908676517843
iteration 294: w = [1.00046042 1.98948863 2.94636939 3.98989309 4.96608398], F(w) = 0.7850913767476965
iteration 295: w = [1.0004608  1.98948888 2.9463693  3.98989307 4.96608396], F(w) = 0.7850918823050815
iteration 296: w = [1.00046118 1.98948912 2.94636921 3.98989305 4.96608393], F(w) = 0.7850923843606263
iteration 297: w = [1.00046155 1.98948937 2.94636912 3.98989302 4.96608391], F(w) = 0.785092882950519
iteration 298: w = [1.00046192 1.98948961 2.94636903 3.989893   4.96608388], F(w) = 0.7850933781103591
iteration 299: w = [1.00046229 1.98948986 2.94636894 3.98989298 4.96608386], F(w) = 0.7850938698754011
iteration 300: w = [1.00046266 1.9894901  2.94636885 3.98989296 4.96608384], F(w) = 0.7850943582803271
iteration 301: w = [1.00046303 1.98949034 2.94636876 3.98989294 4.96608381], F(w) = 0.7850948433593913
iteration 302: w = [1.00046339 1.98949057 2.94636867 3.98989292 4.96608379], F(w) = 0.7850953251463704
iteration 303: w = [1.00046375 1.98949081 2.94636859 3.9898929  4.96608376], F(w) = 0.7850958036745851
iteration 304: w = [1.00046411 1.98949104 2.9463685  3.98989288 4.96608374], F(w) = 0.7850962789769471
iteration 305: w = [1.00046446 1.98949128 2.94636841 3.98989286 4.96608372], F(w) = 0.7850967510858218
iteration 306: w = [1.00046482 1.98949151 2.94636833 3.98989284 4.9660837 ], F(w) = 0.7850972200332205
iteration 307: w = [1.00046517 1.98949174 2.94636824 3.98989282 4.96608367], F(w) = 0.78509768585075
iteration 308: w = [1.00046551 1.98949196 2.94636816 3.9898928  4.96608365], F(w) = 0.7850981485696034
iteration 309: w = [1.00046586 1.98949219 2.94636808 3.98989278 4.96608363], F(w) = 0.7850986082204512
iteration 310: w = [1.0004662  1.98949242 2.94636799 3.98989276 4.96608361], F(w) = 0.7850990648336742
iteration 311: w = [1.00046655 1.98949264 2.94636791 3.98989274 4.96608358], F(w) = 0.7850995184392066
iteration 312: w = [1.00046689 1.98949286 2.94636783 3.98989272 4.96608356], F(w) = 0.7850999690666155
iteration 313: w = [1.00046722 1.98949308 2.94636775 3.9898927  4.96608354], F(w) = 0.7851004167450529
iteration 314: w = [1.00046756 1.9894933  2.94636767 3.98989268 4.96608352], F(w) = 0.7851008615032992
iteration 315: w = [1.00046789 1.98949352 2.94636758 3.98989266 4.9660835 ], F(w) = 0.7851013033697618
iteration 316: w = [1.00046822 1.98949374 2.94636751 3.98989264 4.96608347], F(w) = 0.7851017423725162
iteration 317: w = [1.00046855 1.98949396 2.94636743 3.98989262 4.96608345], F(w) = 0.7851021785392285
iteration 318: w = [1.00046888 1.98949417 2.94636735 3.98989261 4.96608343], F(w) = 0.7851026118972707
iteration 319: w = [1.0004692  1.98949438 2.94636727 3.98989259 4.96608341], F(w) = 0.7851030424735693
iteration 320: w = [1.00046953 1.98949459 2.94636719 3.98989257 4.96608339], F(w) = 0.7851034702948211
iteration 321: w = [1.00046985 1.9894948  2.94636711 3.98989255 4.96608337], F(w) = 0.7851038953872823
iteration 322: w = [1.00047017 1.98949501 2.94636704 3.98989253 4.96608335], F(w) = 0.7851043177769272
iteration 323: w = [1.00047048 1.98949522 2.94636696 3.98989252 4.96608333], F(w) = 0.7851047374894204
iteration 324: w = [1.0004708  1.98949543 2.94636688 3.9898925  4.96608331], F(w) = 0.7851051545500343
iteration 325: w = [1.00047111 1.98949563 2.94636681 3.98989248 4.96608329], F(w) = 0.7851055689838194
iteration 326: w = [1.00047142 1.98949584 2.94636673 3.98989246 4.96608327], F(w) = 0.7851059808154159
iteration 327: w = [1.00047173 1.98949604 2.94636666 3.98989245 4.96608325], F(w) = 0.7851063900692022
iteration 328: w = [1.00047204 1.98949624 2.94636659 3.98989243 4.96608323], F(w) = 0.7851067967693225
iteration 329: w = [1.00047234 1.98949644 2.94636651 3.98989241 4.96608321], F(w) = 0.7851072009394614
iteration 330: w = [1.00047265 1.98949664 2.94636644 3.98989239 4.96608319], F(w) = 0.7851076026031698
iteration 331: w = [1.00047295 1.98949684 2.94636637 3.98989238 4.96608317], F(w) = 0.7851080017835878
iteration 332: w = [1.00047325 1.98949703 2.94636629 3.98989236 4.96608315], F(w) = 0.7851083985036333
iteration 333: w = [1.00047355 1.98949723 2.94636622 3.98989234 4.96608313], F(w) = 0.7851087927859385
iteration 334: w = [1.00047385 1.98949742 2.94636615 3.98989233 4.96608311], F(w) = 0.7851091846529004
iteration 335: w = [1.00047414 1.98949762 2.94636608 3.98989231 4.96608309], F(w) = 0.7851095741265637
iteration 336: w = [1.00047443 1.98949781 2.94636601 3.9898923  4.96608307], F(w) = 0.7851099612287261
iteration 337: w = [1.00047472 1.989498   2.94636594 3.98989228 4.96608305], F(w) = 0.7851103459809524
iteration 338: w = [1.00047501 1.98949819 2.94636587 3.98989226 4.96608303], F(w) = 0.7851107284045398
iteration 339: w = [1.0004753  1.98949838 2.9463658  3.98989225 4.96608301], F(w) = 0.785111108520491
iteration 340: w = [1.00047559 1.98949857 2.94636573 3.98989223 4.966083  ], F(w) = 0.7851114863496015
iteration 341: w = [1.00047587 1.98949875 2.94636566 3.98989222 4.96608298], F(w) = 0.7851118619124254
iteration 342: w = [1.00047615 1.98949894 2.9463656  3.9898922  4.96608296], F(w) = 0.785112235229204
iteration 343: w = [1.00047644 1.98949912 2.94636553 3.98989219 4.96608294], F(w) = 0.7851126063200494
iteration 344: w = [1.00047671 1.98949931 2.94636546 3.98989217 4.96608292], F(w) = 0.7851129752047401
iteration 345: w = [1.00047699 1.98949949 2.94636539 3.98989216 4.9660829 ], F(w) = 0.7851133419028202
iteration 346: w = [1.00047727 1.98949967 2.94636533 3.98989214 4.96608289], F(w) = 0.7851137064336574
iteration 347: w = [1.00047754 1.98949985 2.94636526 3.98989213 4.96608287], F(w) = 0.7851140688164069
iteration 348: w = [1.00047782 1.98950003 2.9463652  3.98989211 4.96608285], F(w) = 0.7851144290698872
iteration 349: w = [1.00047809 1.98950021 2.94636513 3.9898921  4.96608283], F(w) = 0.7851147872127956
iteration 350: w = [1.00047836 1.98950039 2.94636507 3.98989208 4.96608282], F(w) = 0.785115143263614
iteration 351: w = [1.00047863 1.98950056 2.946365   3.98989207 4.9660828 ], F(w) = 0.7851154972405925
iteration 352: w = [1.00047889 1.98950074 2.94636494 3.98989205 4.96608278], F(w) = 0.7851158491616952
iteration 353: w = [1.00047916 1.98950091 2.94636488 3.98989204 4.96608276], F(w) = 0.785116199044771
iteration 354: w = [1.00047942 1.98950108 2.94636481 3.98989202 4.96608275], F(w) = 0.7851165469074628
iteration 355: w = [1.00047969 1.98950126 2.94636475 3.98989201 4.96608273], F(w) = 0.785116892767187
iteration 356: w = [1.00047995 1.98950143 2.94636469 3.98989199 4.96608271], F(w) = 0.7851172366411079
iteration 357: w = [1.00048021 1.9895016  2.94636462 3.98989198 4.9660827 ], F(w) = 0.7851175785463176
iteration 358: w = [1.00048046 1.98950177 2.94636456 3.98989197 4.96608268], F(w) = 0.7851179184996137
iteration 359: w = [1.00048072 1.98950194 2.9463645  3.98989195 4.96608266], F(w) = 0.7851182565176021
iteration 360: w = [1.00048098 1.9895021  2.94636444 3.98989194 4.96608264], F(w) = 0.7851185926167517
iteration 361: w = [1.00048123 1.98950227 2.94636438 3.98989193 4.96608263], F(w) = 0.7851189268133248
iteration 362: w = [1.00048148 1.98950244 2.94636432 3.98989191 4.96608261], F(w) = 0.7851192591234035
iteration 363: w = [1.00048173 1.9895026  2.94636426 3.9898919  4.9660826 ], F(w) = 0.7851195895628772
iteration 364: w = [1.00048198 1.98950276 2.9463642  3.98989189 4.96608258], F(w) = 0.7851199181474232
iteration 365: w = [1.00048223 1.98950293 2.94636414 3.98989187 4.96608256], F(w) = 0.7851202448926589
iteration 366: w = [1.00048248 1.98950309 2.94636408 3.98989186 4.96608255], F(w) = 0.7851205698139199
iteration 367: w = [1.00048272 1.98950325 2.94636402 3.98989185 4.96608253], F(w) = 0.7851208929264082
iteration 368: w = [1.00048297 1.98950341 2.94636396 3.98989183 4.96608251], F(w) = 0.7851212142451416
iteration 369: w = [1.00048321 1.98950357 2.94636391 3.98989182 4.9660825 ], F(w) = 0.7851215337849993
iteration 370: w = [1.00048345 1.98950373 2.94636385 3.98989181 4.96608248], F(w) = 0.785121851560678
iteration 371: w = [1.00048369 1.98950389 2.94636379 3.98989179 4.96608247], F(w) = 0.7851221675867486
iteration 372: w = [1.00048393 1.98950404 2.94636373 3.98989178 4.96608245], F(w) = 0.7851224818775726
iteration 373: w = [1.00048417 1.9895042  2.94636368 3.98989177 4.96608244], F(w) = 0.7851227944473872
iteration 374: w = [1.00048441 1.98950436 2.94636362 3.98989176 4.96608242], F(w) = 0.7851231053102439
iteration 375: w = [1.00048464 1.98950451 2.94636356 3.98989174 4.96608241], F(w) = 0.7851234144800429
iteration 376: w = [1.00048488 1.98950466 2.94636351 3.98989173 4.96608239], F(w) = 0.7851237219705981
iteration 377: w = [1.00048511 1.98950482 2.94636345 3.98989172 4.96608237], F(w) = 0.785124027795514
iteration 378: w = [1.00048534 1.98950497 2.9463634  3.98989171 4.96608236], F(w) = 0.7851243319682425
iteration 379: w = [1.00048557 1.98950512 2.94636334 3.98989169 4.96608234], F(w) = 0.7851246345021032
iteration 380: w = [1.0004858  1.98950527 2.94636329 3.98989168 4.96608233], F(w) = 0.7851249354103356
iteration 381: w = [1.00048603 1.98950542 2.94636323 3.98989167 4.96608231], F(w) = 0.7851252347059412
iteration 382: w = [1.00048625 1.98950557 2.94636318 3.98989166 4.9660823 ], F(w) = 0.7851255324018243
iteration 383: w = [1.00048648 1.98950572 2.94636313 3.98989165 4.96608228], F(w) = 0.7851258285107569
iteration 384: w = [1.0004867  1.98950586 2.94636307 3.98989163 4.96608227], F(w) = 0.7851261230453455
iteration 385: w = [1.00048693 1.98950601 2.94636302 3.98989162 4.96608226], F(w) = 0.7851264160180994
iteration 386: w = [1.00048715 1.98950616 2.94636297 3.98989161 4.96608224], F(w) = 0.7851267074414412
iteration 387: w = [1.00048737 1.9895063  2.94636291 3.9898916  4.96608223], F(w) = 0.7851269973275652
iteration 388: w = [1.00048759 1.98950645 2.94636286 3.98989159 4.96608221], F(w) = 0.7851272856885887
iteration 389: w = [1.00048781 1.98950659 2.94636281 3.98989158 4.9660822 ], F(w) = 0.785127572536454
iteration 390: w = [1.00048803 1.98950673 2.94636276 3.98989157 4.96608218], F(w) = 0.7851278578830868
iteration 391: w = [1.00048824 1.98950687 2.94636271 3.98989155 4.96608217], F(w) = 0.7851281417401664
iteration 392: w = [1.00048846 1.98950702 2.94636265 3.98989154 4.96608215], F(w) = 0.7851284241193256
iteration 393: w = [1.00048867 1.98950716 2.9463626  3.98989153 4.96608214], F(w) = 0.7851287050320519
iteration 394: w = [1.00048889 1.9895073  2.94636255 3.98989152 4.96608213], F(w) = 0.7851289844897278
iteration 395: w = [1.0004891  1.98950744 2.9463625  3.98989151 4.96608211], F(w) = 0.7851292625035889
iteration 396: w = [1.00048931 1.98950758 2.94636245 3.9898915  4.9660821 ], F(w) = 0.7851295390847881
iteration 397: w = [1.00048952 1.98950771 2.9463624  3.98989149 4.96608209], F(w) = 0.7851298142443517
iteration 398: w = [1.00048973 1.98950785 2.94636235 3.98989148 4.96608207], F(w) = 0.7851300879931978
iteration 399: w = [1.00048994 1.98950799 2.9463623  3.98989147 4.96608206], F(w) = 0.7851303603420933
iteration 400: w = [1.00049014 1.98950812 2.94636225 3.98989145 4.96608204], F(w) = 0.7851306313017814
iteration 401: w = [1.00049035 1.98950826 2.94636221 3.98989144 4.96608203], F(w) = 0.785130900882812
iteration 402: w = [1.00049055 1.98950839 2.94636216 3.98989143 4.96608202], F(w) = 0.785131169095667
iteration 403: w = [1.00049076 1.98950853 2.94636211 3.98989142 4.966082  ], F(w) = 0.785131435950742
iteration 404: w = [1.00049096 1.98950866 2.94636206 3.98989141 4.96608199], F(w) = 0.7851317014582577
iteration 405: w = [1.00049116 1.98950879 2.94636201 3.9898914  4.96608198], F(w) = 0.785131965628416
iteration 406: w = [1.00049136 1.98950892 2.94636196 3.98989139 4.96608196], F(w) = 0.7851322284712663
iteration 407: w = [1.00049156 1.98950906 2.94636192 3.98989138 4.96608195], F(w) = 0.7851324899967711
iteration 408: w = [1.00049176 1.98950919 2.94636187 3.98989137 4.96608194], F(w) = 0.7851327502147704
iteration 409: w = [1.00049196 1.98950932 2.94636182 3.98989136 4.96608193], F(w) = 0.785133009135049
iteration 410: w = [1.00049216 1.98950945 2.94636178 3.98989135 4.96608191], F(w) = 0.7851332667672423
iteration 411: w = [1.00049235 1.98950957 2.94636173 3.98989134 4.9660819 ], F(w) = 0.7851335231209808
iteration 412: w = [1.00049255 1.9895097  2.94636168 3.98989133 4.96608189], F(w) = 0.7851337782056954
iteration 413: w = [1.00049274 1.98950983 2.94636164 3.98989132 4.96608187], F(w) = 0.7851340320307852
iteration 414: w = [1.00049293 1.98950996 2.94636159 3.98989131 4.96608186], F(w) = 0.7851342846055205
iteration 415: w = [1.00049313 1.98951008 2.94636155 3.9898913  4.96608185], F(w) = 0.7851345359391115
iteration 416: w = [1.00049332 1.98951021 2.9463615  3.98989129 4.96608184], F(w) = 0.7851347860407074
iteration 417: w = [1.00049351 1.98951033 2.94636146 3.98989128 4.96608182], F(w) = 0.7851350349192731
iteration 418: w = [1.0004937  1.98951046 2.94636141 3.98989127 4.96608181], F(w) = 0.7851352825837639
iteration 419: w = [1.00049389 1.98951058 2.94636137 3.98989126 4.9660818 ], F(w) = 0.785135529043055
iteration 420: w = [1.00049407 1.98951071 2.94636132 3.98989125 4.96608179], F(w) = 0.7851357743058499
iteration 421: w = [1.00049426 1.98951083 2.94636128 3.98989124 4.96608177], F(w) = 0.7851360183809013
iteration 422: w = [1.00049445 1.98951095 2.94636123 3.98989123 4.96608176], F(w) = 0.785136261276719
iteration 423: w = [1.00049463 1.98951107 2.94636119 3.98989122 4.96608175], F(w) = 0.7851365030018572
iteration 424: w = [1.00049482 1.98951119 2.94636115 3.98989122 4.96608174], F(w) = 0.7851367435647346
iteration 425: w = [1.000495   1.98951131 2.9463611  3.98989121 4.96608173], F(w) = 0.7851369829737227
iteration 426: w = [1.00049518 1.98951143 2.94636106 3.9898912  4.96608171], F(w) = 0.7851372212370656
iteration 427: w = [1.00049536 1.98951155 2.94636102 3.98989119 4.9660817 ], F(w) = 0.7851374583629602
iteration 428: w = [1.00049554 1.98951167 2.94636097 3.98989118 4.96608169], F(w) = 0.7851376943595089
iteration 429: w = [1.00049572 1.98951179 2.94636093 3.98989117 4.96608168], F(w) = 0.7851379292347211
iteration 430: w = [1.0004959  1.98951191 2.94636089 3.98989116 4.96608167], F(w) = 0.7851381629966302
iteration 431: w = [1.00049608 1.98951203 2.94636085 3.98989115 4.96608165], F(w) = 0.7851383956530896
iteration 432: w = [1.00049626 1.98951214 2.9463608  3.98989114 4.96608164], F(w) = 0.7851386272118983
iteration 433: w = [1.00049643 1.98951226 2.94636076 3.98989113 4.96608163], F(w) = 0.7851388576807761
iteration 434: w = [1.00049661 1.98951237 2.94636072 3.98989112 4.96608162], F(w) = 0.7851390870674224
iteration 435: w = [1.00049678 1.98951249 2.94636068 3.98989112 4.96608161], F(w) = 0.7851393153794126
iteration 436: w = [1.00049696 1.9895126  2.94636064 3.98989111 4.9660816 ], F(w) = 0.7851395426242526
iteration 437: w = [1.00049713 1.98951272 2.9463606  3.9898911  4.96608158], F(w) = 0.7851397688094055
iteration 438: w = [1.0004973  1.98951283 2.94636056 3.98989109 4.96608157], F(w) = 0.7851399939422816
iteration 439: w = [1.00049748 1.98951294 2.94636052 3.98989108 4.96608156], F(w) = 0.7851402180301427
iteration 440: w = [1.00049765 1.98951306 2.94636047 3.98989107 4.96608155], F(w) = 0.7851404410802728
iteration 441: w = [1.00049782 1.98951317 2.94636043 3.98989106 4.96608154], F(w) = 0.7851406630998474
iteration 442: w = [1.00049799 1.98951328 2.94636039 3.98989106 4.96608153], F(w) = 0.7851408840959694
iteration 443: w = [1.00049816 1.98951339 2.94636035 3.98989105 4.96608152], F(w) = 0.7851411040756853
iteration 444: w = [1.00049832 1.9895135  2.94636032 3.98989104 4.96608151], F(w) = 0.7851413230460129
iteration 445: w = [1.00049849 1.98951361 2.94636028 3.98989103 4.96608149], F(w) = 0.7851415410138604
iteration 446: w = [1.00049866 1.98951372 2.94636024 3.98989102 4.96608148], F(w) = 0.7851417579860612
iteration 447: w = [1.00049882 1.98951383 2.9463602  3.98989101 4.96608147], F(w) = 0.7851419739694308
iteration 448: w = [1.00049899 1.98951394 2.94636016 3.98989101 4.96608146], F(w) = 0.7851421889706816
iteration 449: w = [1.00049915 1.98951405 2.94636012 3.989891   4.96608145], F(w) = 0.7851424029965248
iteration 450: w = [1.00049932 1.98951415 2.94636008 3.98989099 4.96608144], F(w) = 0.7851426160535441
iteration 451: w = [1.00049948 1.98951426 2.94636004 3.98989098 4.96608143], F(w) = 0.7851428281483025
iteration 452: w = [1.00049964 1.98951437 2.94636    3.98989097 4.96608142], F(w) = 0.7851430392872643
iteration 453: w = [1.0004998  1.98951447 2.94635997 3.98989096 4.96608141], F(w) = 0.7851432494769043
iteration 454: w = [1.00049996 1.98951458 2.94635993 3.98989096 4.9660814 ], F(w) = 0.7851434587235875
iteration 455: w = [1.00050012 1.98951468 2.94635989 3.98989095 4.96608139], F(w) = 0.7851436670336284
iteration 456: w = [1.00050028 1.98951479 2.94635985 3.98989094 4.96608138], F(w) = 0.7851438744133116
iteration 457: w = [1.00050044 1.98951489 2.94635982 3.98989093 4.96608137], F(w) = 0.7851440808688005
iteration 458: w = [1.0005006  1.989515   2.94635978 3.98989093 4.96608136], F(w) = 0.7851442864063073
iteration 459: w = [1.00050076 1.9895151  2.94635974 3.98989092 4.96608135], F(w) = 0.7851444910318743
iteration 460: w = [1.00050091 1.9895152  2.9463597  3.98989091 4.96608133], F(w) = 0.7851446947515957
iteration 461: w = [1.00050107 1.98951531 2.94635967 3.9898909  4.96608132], F(w) = 0.7851448975714144
iteration 462: w = [1.00050122 1.98951541 2.94635963 3.98989089 4.96608131], F(w) = 0.7851450994973083
iteration 463: w = [1.00050138 1.98951551 2.94635959 3.98989089 4.9660813 ], F(w) = 0.7851453005351495
iteration 464: w = [1.00050153 1.98951561 2.94635956 3.98989088 4.96608129], F(w) = 0.7851455006908215
iteration 465: w = [1.00050168 1.98951571 2.94635952 3.98989087 4.96608128], F(w) = 0.7851456999700751
iteration 466: w = [1.00050184 1.98951581 2.94635949 3.98989086 4.96608127], F(w) = 0.7851458983786112
iteration 467: w = [1.00050199 1.98951591 2.94635945 3.98989086 4.96608126], F(w) = 0.7851460959221823
iteration 468: w = [1.00050214 1.98951601 2.94635941 3.98989085 4.96608125], F(w) = 0.7851462926063508
iteration 469: w = [1.00050229 1.98951611 2.94635938 3.98989084 4.96608124], F(w) = 0.7851464884367354
iteration 470: w = [1.00050244 1.98951621 2.94635934 3.98989083 4.96608123], F(w) = 0.78514668341887
iteration 471: w = [1.00050259 1.98951631 2.94635931 3.98989083 4.96608122], F(w) = 0.7851468775582822
iteration 472: w = [1.00050274 1.98951641 2.94635927 3.98989082 4.96608121], F(w) = 0.7851470708603957
iteration 473: w = [1.00050289 1.9895165  2.94635924 3.98989081 4.9660812 ], F(w) = 0.7851472633305996
iteration 474: w = [1.00050303 1.9895166  2.9463592  3.98989081 4.96608119], F(w) = 0.7851474549742562
iteration 475: w = [1.00050318 1.9895167  2.94635917 3.9898908  4.96608118], F(w) = 0.7851476457966177
iteration 476: w = [1.00050333 1.98951679 2.94635913 3.98989079 4.96608118], F(w) = 0.7851478358030054
iteration 477: w = [1.00050347 1.98951689 2.9463591  3.98989078 4.96608117], F(w) = 0.7851480249985772
iteration 478: w = [1.00050362 1.98951698 2.94635907 3.98989078 4.96608116], F(w) = 0.7851482133885693
iteration 479: w = [1.00050376 1.98951708 2.94635903 3.98989077 4.96608115], F(w) = 0.7851484009780704
iteration 480: w = [1.0005039  1.98951717 2.946359   3.98989076 4.96608114], F(w) = 0.7851485877721782
iteration 481: w = [1.00050405 1.98951727 2.94635896 3.98989076 4.96608113], F(w) = 0.7851487737759294
iteration 482: w = [1.00050419 1.98951736 2.94635893 3.98989075 4.96608112], F(w) = 0.7851489589943021
iteration 483: w = [1.00050433 1.98951745 2.9463589  3.98989074 4.96608111], F(w) = 0.785149143432289
iteration 484: w = [1.00050447 1.98951755 2.94635886 3.98989073 4.9660811 ], F(w) = 0.7851493270947818
iteration 485: w = [1.00050461 1.98951764 2.94635883 3.98989073 4.96608109], F(w) = 0.7851495099866547
iteration 486: w = [1.00050475 1.98951773 2.9463588  3.98989072 4.96608108], F(w) = 0.7851496921127462
iteration 487: w = [1.00050489 1.98951782 2.94635877 3.98989071 4.96608107], F(w) = 0.7851498734778439
iteration 488: w = [1.00050503 1.98951792 2.94635873 3.98989071 4.96608106], F(w) = 0.7851500540866997
iteration 489: w = [1.00050517 1.98951801 2.9463587  3.9898907  4.96608105], F(w) = 0.785150233944051
iteration 490: w = [1.00050531 1.9895181  2.94635867 3.98989069 4.96608104], F(w) = 0.7851504130545109
iteration 491: w = [1.00050545 1.98951819 2.94635864 3.98989069 4.96608103], F(w) = 0.7851505914227966
iteration 492: w = [1.00050558 1.98951828 2.9463586  3.98989068 4.96608103], F(w) = 0.7851507690534424
iteration 493: w = [1.00050572 1.98951837 2.94635857 3.98989067 4.96608102], F(w) = 0.7851509459510411
iteration 494: w = [1.00050586 1.98951846 2.94635854 3.98989067 4.96608101], F(w) = 0.7851511221200721
iteration 495: w = [1.00050599 1.98951855 2.94635851 3.98989066 4.966081  ], F(w) = 0.7851512975650744
iteration 496: w = [1.00050613 1.98951864 2.94635848 3.98989065 4.96608099], F(w) = 0.7851514722904505
iteration 497: w = [1.00050626 1.98951872 2.94635844 3.98989065 4.96608098], F(w) = 0.785151646300623
iteration 498: w = [1.00050639 1.98951881 2.94635841 3.98989064 4.96608097], F(w) = 0.7851518196000051
iteration 499: w = [1.00050653 1.9895189  2.94635838 3.98989064 4.96608096], F(w) = 0.7851519921929033

Summary


$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$